Nov 01 09:27:40 devstack cinder-volume[75556]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 09:27:40 devstack cinder-volume[75556]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 09:27:40 devstack cinder-volume[75556]: we strongly recommend against using it for new projects. Nov 01 09:27:40 devstack cinder-volume[75556]: If you are already using Eventlet, we recommend migrating to a different Nov 01 09:27:40 devstack cinder-volume[75556]: framework. For more detail see Nov 01 09:27:40 devstack cinder-volume[75556]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 09:27:40 devstack cinder-volume[75556]: import eventlet # noqa Nov 01 09:27:43 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 09:27:43 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 09:27:43 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 09:27:44 devstack cinder-volume[75556]: INFO dbcounter [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Registered counter for database cinder Nov 01 09:27:44 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:27:44 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writer thread running {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 09:27:44 devstack cinder-volume[75556]: INFO cinder.rpc [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 09:27:44 devstack cinder-volume[75556]: INFO cinder.rpc [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 09:27:44 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:27:44 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Determined volume DB was empty at startup. Nov 01 09:27:44 devstack cinder-volume[75556]: DEBUG cinder.volume.manager [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75556) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 09:27:44 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 01 09:27:44 devstack cinder-volume[75556]: WARNING stevedore.named [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 09:27:44 devstack cinder-volume[75556]: WARNING castellan.key_manager [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 09:27:44 devstack cinder-volume[75556]: WARNING cinder.keymgr.conf_key_mgr [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 09:27:44 devstack cinder-volume[75556]: DEBUG cinder.volume.drivers.lvm [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75556) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 01 09:27:44 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_concurrency.processutils [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] CMD "cinder-rtstool verify" returned: 0 in 0.509s {{(pid=75556) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:27:45 devstack cinder-volume[75556]: INFO cinder.rpc [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 01 09:27:45 devstack cinder-volume[75556]: INFO cinder.rpc [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 01 09:27:45 devstack cinder-volume[75556]: WARNING stevedore.named [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 09:27:45 devstack cinder-volume[75556]: WARNING castellan.key_manager [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 09:27:45 devstack cinder-volume[75556]: INFO cinder.volume.manager [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_db.sqlalchemy.engines [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75556) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:27:45 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Starting 1 workers Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Started child 75707 {{(pid=75556) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Full set of CONF: {{(pid=75556) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] ******************************************************************************** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Configuration options gathered from: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] ================================================================================ {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] allow_availability_zone_fallback = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] allow_compression_on_image_upload = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] allowed_direct_url_schemes = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75707]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] api_rate_limit = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] auth_strategy = keystone {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] az_cache_duration = 3600 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_availability_zone = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_host = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_stats_polling_interval = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backup_api_class = cinder.backup.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backup_name_template = backup-%s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backup_use_same_host = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backup_use_temp_snapshot = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] chap_password = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] chap_username = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_internal_tenant_project_id = 5c590f6657c146fd8189ef41694ff8b7 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_internal_tenant_user_id = 8dac8261e09c4d1c81aca51df20a4122 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cloned_volume_same_az = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cluster = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] compression_format = gzip {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] compute_api_class = cinder.compute.nova.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] config_dir = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] config_source = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] control_exchange = openstack {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] debug = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] default_availability_zone = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] default_group_type = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] default_volume_type = lvmdriver-1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] disk_geometry = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] driver_client_cert = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] driver_client_cert_key = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] driver_data_namespace = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] driver_ssl_cert_path = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] driver_ssl_cert_verify = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] driver_use_ssl = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] enable_force_upload = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] enable_new_services = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] enable_unsupported_driver = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] enabled_backends = ['lvmdriver-1'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] enforce_multipath_for_image_xfer = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] filter_function = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_api_insecure = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_api_servers = ['http://192.168.122.47/image'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_api_ssl_compression = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_ca_certificates_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_catalog_info = image:glance:publicURL {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_num_retries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance_request_timeout = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] goodness_function = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] graceful_shutdown_timeout = 5 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] group_api_class = cinder.group.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] host = devstack {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_compress_on_upload = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_conversion_address_space_limit = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_conversion_cpu_limit = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75707]: INFO cinder.volume.manager [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 01 09:27:45 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_conversion_disable = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_introspection_address_space_limit = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_introspection_cpu_limit = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_upload_use_cinder_backend = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_upload_use_internal_tenant = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_volume_cache_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_volume_cache_max_count = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] image_volume_cache_max_size_gb = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] init_host_max_objects_retrieval = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] instance_format = [instance: %(uuid)s] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] iscsi_target_flags = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] iscsi_write_cache = on {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] iser_helper = tgtadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] iser_ip_address = 192.168.122.47 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] iser_port = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_color = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_config_append = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_dir = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_options = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_rotate_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_rotate_interval_type = days {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] log_rotation_type = none {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] max_age = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] max_logfile_count = 30 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] max_logfile_size_mb = 200 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] max_over_subscription_ratio = 20.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] message_reap_interval = 86400 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] message_ttl = 2592000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] migration_create_volume_timeout_secs = 300 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] monkey_patch = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] monkey_patch_modules = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] my_ip = 192.168.122.47 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] no_snapshot_gb_quota = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] num_iser_scan_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] num_shell_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] num_volume_device_scan_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] nvmeof_conn_info_version = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] nvmet_ns_id = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] nvmet_port_id = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] osapi_max_limit = 1000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] osapi_volume_ext_list = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] osapi_volume_listen = 0.0.0.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] osapi_volume_listen_port = 8776 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] osapi_volume_use_ssl = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] osapi_volume_workers = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] per_volume_size_limit = -1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] periodic_fuzzy_delay = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] periodic_interval = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] project_id_regex = [0-9a-f\-]+ {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] public_endpoint = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] publish_errors = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] quota_backup_gigabytes = 1000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] quota_backups = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] quota_gigabytes = 1000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] quota_groups = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] quota_snapshots = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] quota_volumes = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] rate_limit_burst = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] rate_limit_except_level = CRITICAL {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] rate_limit_interval = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] reinit_driver_count = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] replication_device = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] report_discard_supported = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] report_interval = 120 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] reservation_clean_interval = 86400 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] reservation_expire = 86400 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] reserved_image_namespaces = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] reserved_percentage = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] rpc_response_timeout = 120 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] run_external_periodic_tasks = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] scst_target_driver = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] scst_target_iqn_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_down_time = 720 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] shell_completion = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] snapshot_name_template = snapshot-%s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] snapshot_same_host = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] split_loggers = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] state_path = /opt/stack/data/cinder {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] storage_availability_zone = nova {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] storage_protocol = iSCSI {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] syslog_log_facility = LOG_USER {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] target_helper = lioadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] target_ip_address = 192.168.122.47 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] target_port = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] target_protocol = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] target_secondary_ip_addresses = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] trace_flags = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] transfer_api_class = cinder.transfer.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] transport_url = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] until_refresh = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] use_chap_auth = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] use_default_quota_class = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] use_journal = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] use_json = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] use_multipath_for_image_xfer = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] use_stderr = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] use_syslog = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] verify_glance_signatures = enabled {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_api_class = cinder.volume.api.API {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_backend_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_clear = zero {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_clear_ionice = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_clear_size = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_copy_bps_limit = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_dd_blocksize = 1M {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_name_template = volume-%s {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_service_inithost_offload = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volume_usage_audit_period = month {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] zoning_mode = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_concurrency.disable_process_locking = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.auth_section = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.auth_type = password {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.auth_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.cache = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.delay_auth_decision = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.http_connect_timeout = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.include_service_catalog = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.insecure = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.interface = public {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_password = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcache_username = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.region_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.service_token_roles_required = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.service_type = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.token_cache_time = 300 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.47/identity {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.backend = dogpile.cache.null {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.backend_argument = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.backend_expiration_time = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.config_prefix = cache.oslo {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack sudo[75712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 01 09:27:45 devstack sudo[75712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.debug_cache_backend = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.enable_retry_client = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.enable_socket_keepalive = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.expiration_time = 600 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.hashclient_retry_attempts = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.memcache_dead_retry = 300 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.memcache_pool_maxsize = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.memcache_sasl_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.password = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.proxies = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.redis_db = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.redis_sentinel_service_name = mymaster {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.redis_server = localhost:6379 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.retry_attempts = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.retry_delay = 0.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.socket_keepalive_count = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.socket_keepalive_idle = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.socket_keepalive_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.socket_timeout = 1.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.tls_allowed_ciphers = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.tls_cafile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.tls_certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.tls_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.tls_keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cache.username = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] coordination.backend_url = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.asyncio_connection = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.asyncio_slave_connection = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.backend = sqlalchemy {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.connection = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.connection_debug = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.connection_parameters = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.connection_recycle_time = 3600 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.connection_trace = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.db_inc_retry_interval = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.db_max_retries = 20 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.db_max_retry_interval = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.db_retry_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.max_overflow = 50 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.max_pool_size = 5 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.max_retries = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.mysql_wsrep_sync_wait = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.pool_timeout = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.retry_interval = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.slave_connection = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.sqlite_synchronous = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.synchronous_reader = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] database.use_db_reconnect = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_tracing.insecure = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:45 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.connection_string = messaging:// {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.es_doc_type = notification {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.es_scroll_size = 10000 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.es_scroll_time = 2m {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.filter_error_trace = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.hmac_keys = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.sentinel_service_name = mymaster {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.socket_timeout = 0.1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.trace_requests = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler.trace_sqlalchemy = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler_jaeger.process_tags = {} {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler_jaeger.service_name_prefix = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] profiler_otlp.service_name_prefix = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.enforce_new_defaults = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.policy_default_rule = default {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.policy_file = policy.yaml {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_policy.remote_timeout = 60.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] privsep_osbrick.group = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] privsep_osbrick.helper_command = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] privsep_osbrick.user = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_sys_admin.group = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_sys_admin.helper_command = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] cinder_sys_admin.user = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.auth_section = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.auth_type = password {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.cafile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.collect_timing = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.insecure = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.send_service_user_token = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.split_loggers = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.timeout = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.tls_ciphers = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] service_user.tls_min_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.auth_section = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.auth_type = password {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.collect_timing = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.insecure = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.region_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.split_loggers = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.timeout = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.tls_ciphers = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] glance.tls_min_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.backend_availability_zone = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.chap_password = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.chap_username = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.disk_geometry = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.driver_client_cert = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.driver_client_cert_key = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.driver_data_namespace = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.driver_use_ssl = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.enable_unsupported_driver = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.extra_capabilities = {} {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.filter_function = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.goodness_function = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.iscsi_target_flags = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.iscsi_write_cache = on {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.iser_helper = tgtadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.iser_ip_address = 192.168.122.47 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.iser_port = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.lvm_mirrors = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.lvm_share_target = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.lvm_type = auto {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.num_shell_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.nvmet_port_id = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.replication_device = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.report_discard_supported = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.reserved_percentage = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.scst_target_driver = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.scst_target_iqn_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.storage_protocol = iSCSI {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.target_helper = tgtadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.target_ip_address = 192.168.122.47 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.target_port = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.target_protocol = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.trace_flags = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.unique_fqdn_network = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.use_chap_auth = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_backend_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_clear = zero {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_clear_ionice = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_clear_size = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volume_group = cinder-volumes {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_reports.file_event_handler = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_reports.log_dir = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.backend_availability_zone = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.backend_host = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.chap_password = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.chap_username = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.chiscsi_conf = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.disk_geometry = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.driver_client_cert = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.driver_data_namespace = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.driver_use_ssl = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.extra_capabilities = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.filter_function = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.goodness_function = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.iser_helper = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.iser_ip_address = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.iser_port = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.iser_target_prefix = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.lvm_conf_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.lvm_mirrors = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.lvm_share_target = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.lvm_type = auto {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.num_shell_tries = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.nvmet_port_id = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.replication_device = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.report_discard_supported = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.reserved_percentage = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.scst_target_driver = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.storage_protocol = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.target_helper = lioadm {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.target_ip_address = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.target_port = 3260 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.target_protocol = iscsi {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.trace_flags = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.use_chap_auth = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_clear = zero {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_clear_size = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] lvmdriver-1.volumes_dir = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.ssl = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.ssl_version = {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_notifications.driver = [] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_notifications.retry = -1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] oslo_messaging_notifications.transport_url = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] key_manager.fixed_key = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.barbican_api_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.barbican_endpoint = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.barbican_endpoint_type = public {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.barbican_region_name = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.cafile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.collect_timing = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.insecure = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.number_of_retries = 60 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.retry_delay = 1 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.send_service_user_token = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.split_loggers = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.timeout = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.tls_ciphers = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.tls_min_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.verify_ssl = True {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican.verify_ssl_path = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.auth_section = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.auth_type = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.cafile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.certfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.collect_timing = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.insecure = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.keyfile = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.split_loggers = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.timeout = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.tls_ciphers = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] barbican_service_user.tls_min_version = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.approle_role_id = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.approle_secret_id = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.auth_method = approle {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.auth_path = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.kv_mountpoint = secret {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.kv_path = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.kv_version = 2 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.namespace = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.root_token_id = **** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.ssl_ca_crt_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.timeout = 60.0 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.token_file = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.token_role = None {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.use_ssl = False {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:27:46 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] ******************************************************************************** {{(pid=75556) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 09:27:46 devstack sudo[75712]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:46 devstack sudo[75720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:46 devstack sudo[75720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:46 devstack sudo[75720]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.266s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:27:46 devstack cinder-volume[75707]: INFO cinder.brick.local_dev.lvm [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:46 devstack sudo[75852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:27:46 devstack sudo[75852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:46 devstack sudo[75852]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG cinder.brick.local_dev.lvm [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75707) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 01 09:27:46 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:46 devstack sudo[75947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:46 devstack sudo[75947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:47 devstack sudo[75947]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:47 devstack sudo[76136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:47 devstack sudo[76136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:47 devstack sudo[76136]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:47 devstack sudo[76235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 01 09:27:47 devstack sudo[76235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:47 devstack sudo[76235]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.314s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:47 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:47 devstack sudo[76326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:27:47 devstack sudo[76326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:48 devstack sudo[76326]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:48 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:48 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:48 devstack sudo[76329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:27:48 devstack sudo[76329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:48 devstack sudo[76329]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:48 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.367s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:48 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:48 devstack sudo[76413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:27:48 devstack sudo[76413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:48 devstack sudo[76413]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:48 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:48 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:48 devstack sudo[76422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:48 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:49 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:49 devstack sudo[76510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:49 devstack sudo[76510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:49 devstack sudo[76510]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:49 devstack cinder-volume[75707]: INFO cinder.volume.drivers.lvm [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:49 devstack sudo[76516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:49 devstack sudo[76516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:49 devstack sudo[76516]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG cinder.volume.drivers.lvm [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Updating volume stats {{(pid=75707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 09:27:49 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:49 devstack sudo[76519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:27:49 devstack sudo[76519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:50 devstack sudo[76519]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:50 devstack sudo[76522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:27:50 devstack sudo[76522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:50 devstack sudo[76522]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:50 devstack sudo[76525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:50 devstack sudo[76525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:50 devstack sudo[76525]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:50 devstack sudo[76528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:27:50 devstack sudo[76528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:50 devstack sudo[76528]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:50 devstack cinder-volume[75707]: INFO cinder.volume.driver [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG cinder.volume.driver [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75707) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_db.sqlalchemy.engines [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75707) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG dbcounter [-] [75707] Writer thread running {{(pid=75707) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG cinder.db.api [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Building query based on filter {{(pid=75707) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG cinder.image.image_utils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75707) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 09:27:50 devstack cinder-volume[75707]: INFO cinder.keymgr.migration [None req-5bde5b24-7484-4b43-be71-2fd66317090d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG cinder.volume.drivers.lvm [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Updating volume stats {{(pid=75707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 09:27:50 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:50 devstack sudo[76531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:27:50 devstack sudo[76531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:51 devstack sudo[76531]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:51 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:51 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:51 devstack sudo[76537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:27:51 devstack sudo[76537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:51 devstack sudo[76537]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:51 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:51 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:51 devstack sudo[76540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:51 devstack sudo[76540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:51 devstack sudo[76540]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:51 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:51 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:51 devstack sudo[76543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:27:51 devstack sudo[76543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:52 devstack sudo[76543]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG cinder.manager [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Notifying Schedulers of capabilities ... {{(pid=75707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:27:52 devstack cinder-volume[75707]: INFO cinder.volume.manager [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Driver initialization completed successfully. Nov 01 09:27:52 devstack cinder-volume[75707]: INFO cinder.manager [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Initiating service 2 cleanup Nov 01 09:27:52 devstack cinder-volume[75707]: INFO cinder.manager [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Service 2 cleanup completed. Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG cinder.service [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Creating RPC server for service cinder-volume {{(pid=75707) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG cinder.service [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75707) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 09:27:52 devstack cinder-volume[75707]: INFO cinder.volume.manager [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG cinder.volume.drivers.lvm [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Updating volume stats {{(pid=75707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:52 devstack sudo[76549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:27:52 devstack sudo[76549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:52 devstack sudo[76549]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:52 devstack sudo[76554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:27:52 devstack sudo[76554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:52 devstack sudo[76554]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:52 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:52 devstack sudo[76557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:27:52 devstack sudo[76557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:53 devstack sudo[76557]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:53 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:53 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:27:53 devstack sudo[76560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:27:53 devstack sudo[76560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:27:53 devstack sudo[76560]: pam_unix(sudo:session): session closed for user root Nov 01 09:27:53 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:27:53 devstack cinder-volume[75707]: INFO cinder.volume.manager [None req-f344c2b5-a8e1-4d38-b59a-494a992d77a2 None None] Driver post RPC initialization completed successfully. Nov 01 09:27:55 devstack cinder-volume[75556]: DEBUG dbcounter [-] [75556] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75556) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:27:56 devstack cinder-volume[75707]: DEBUG oslo_service.periodic_task [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running periodic task VolumeManager._thread_info {{(pid=75707) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:27:56 devstack cinder-volume[75707]: DEBUG cinder.volume.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] thread count: 6 {{(pid=75707) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:27:56 devstack cinder-volume[75707]: DEBUG cinder.volume.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] thread info: [<_MainThread(MainThread, started 133087485026432)>, , , , , ] {{(pid=75707) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:28:03 devstack cinder-volume[75707]: DEBUG dbcounter [-] [75707] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75707) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:28:03 devstack cinder-volume[75707]: DEBUG dbcounter [-] [75707] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75707) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:28:56 devstack cinder-volume[75707]: DEBUG oslo_service.periodic_task [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75707) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:28:56 devstack cinder-volume[75707]: DEBUG cinder.volume.drivers.lvm [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Updating volume stats {{(pid=75707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 09:28:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:28:56 devstack sudo[78653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:28:56 devstack sudo[78653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:28:56 devstack sudo[78653]: pam_unix(sudo:session): session closed for user root Nov 01 09:28:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:28:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:28:56 devstack sudo[78690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:28:56 devstack sudo[78690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:28:56 devstack sudo[78690]: pam_unix(sudo:session): session closed for user root Nov 01 09:28:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:28:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:28:56 devstack sudo[78693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:28:56 devstack sudo[78693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:28:57 devstack sudo[78693]: pam_unix(sudo:session): session closed for user root Nov 01 09:28:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:28:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:28:57 devstack sudo[78806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:28:57 devstack sudo[78806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:28:57 devstack sudo[78806]: pam_unix(sudo:session): session closed for user root Nov 01 09:28:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:28:57 devstack cinder-volume[75707]: DEBUG cinder.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Notifying Schedulers of capabilities ... {{(pid=75707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:28:57 devstack cinder-volume[75707]: DEBUG oslo_service.periodic_task [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running periodic task VolumeManager._thread_info {{(pid=75707) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:28:57 devstack cinder-volume[75707]: DEBUG cinder.volume.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] thread count: 6 {{(pid=75707) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:28:57 devstack cinder-volume[75707]: DEBUG cinder.volume.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] thread info: [<_MainThread(MainThread, started 133087485026432)>, , , , , ] {{(pid=75707) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:29:56 devstack cinder-volume[75707]: DEBUG oslo_service.periodic_task [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75707) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:29:56 devstack cinder-volume[75707]: DEBUG cinder.volume.drivers.lvm [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Updating volume stats {{(pid=75707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 09:29:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:29:56 devstack sudo[81968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:29:56 devstack sudo[81968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:29:56 devstack sudo[81968]: pam_unix(sudo:session): session closed for user root Nov 01 09:29:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:29:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:29:56 devstack sudo[81979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:29:56 devstack sudo[81979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:29:56 devstack sudo[81979]: pam_unix(sudo:session): session closed for user root Nov 01 09:29:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:29:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:29:56 devstack sudo[82015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:29:56 devstack sudo[82015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:29:57 devstack sudo[82015]: pam_unix(sudo:session): session closed for user root Nov 01 09:29:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:29:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:29:57 devstack sudo[82018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:29:57 devstack sudo[82018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:29:57 devstack sudo[82018]: pam_unix(sudo:session): session closed for user root Nov 01 09:29:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:29:57 devstack cinder-volume[75707]: DEBUG cinder.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Notifying Schedulers of capabilities ... {{(pid=75707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:29:57 devstack cinder-volume[75707]: DEBUG oslo_service.periodic_task [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running periodic task VolumeManager._thread_info {{(pid=75707) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:29:57 devstack cinder-volume[75707]: DEBUG cinder.volume.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] thread count: 6 {{(pid=75707) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:29:57 devstack cinder-volume[75707]: DEBUG cinder.volume.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] thread info: [<_MainThread(MainThread, started 133087485026432)>, , , , , ] {{(pid=75707) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:30:03 devstack cinder-volume[75707]: DEBUG dbcounter [-] [75707] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75707) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:30:56 devstack cinder-volume[75707]: DEBUG oslo_service.periodic_task [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75707) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:30:56 devstack cinder-volume[75707]: DEBUG cinder.volume.drivers.lvm [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Updating volume stats {{(pid=75707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 09:30:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:30:56 devstack sudo[84121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:30:56 devstack sudo[84121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:30:56 devstack sudo[84121]: pam_unix(sudo:session): session closed for user root Nov 01 09:30:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:30:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:30:56 devstack sudo[84135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:30:56 devstack sudo[84135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:30:56 devstack sudo[84135]: pam_unix(sudo:session): session closed for user root Nov 01 09:30:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.235s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:30:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:30:56 devstack sudo[84138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:30:56 devstack sudo[84138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:30:57 devstack sudo[84138]: pam_unix(sudo:session): session closed for user root Nov 01 09:30:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:30:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:30:57 devstack sudo[84145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:30:57 devstack sudo[84145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:30:57 devstack sudo[84145]: pam_unix(sudo:session): session closed for user root Nov 01 09:30:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:30:57 devstack cinder-volume[75707]: DEBUG cinder.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Notifying Schedulers of capabilities ... {{(pid=75707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:30:57 devstack cinder-volume[75707]: DEBUG oslo_service.periodic_task [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running periodic task VolumeManager._thread_info {{(pid=75707) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:30:57 devstack cinder-volume[75707]: DEBUG cinder.volume.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] thread count: 6 {{(pid=75707) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:30:57 devstack cinder-volume[75707]: DEBUG cinder.volume.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] thread info: [<_MainThread(MainThread, started 133087485026432)>, , , , , ] {{(pid=75707) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:31:56 devstack cinder-volume[75707]: DEBUG oslo_service.periodic_task [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75707) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:31:56 devstack cinder-volume[75707]: DEBUG cinder.volume.drivers.lvm [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Updating volume stats {{(pid=75707) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 09:31:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:31:56 devstack sudo[85375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 09:31:56 devstack sudo[85375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:31:56 devstack sudo[85375]: pam_unix(sudo:session): session closed for user root Nov 01 09:31:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:31:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:31:56 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:31:56 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:31:56 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Nov 01 09:31:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:31:56 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:31:56 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 09:31:56 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:31:57 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Nov 01 09:31:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:31:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:31:57 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 09:31:57 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:31:57 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Nov 01 09:31:57 devstack cinder-volume[75707]: DEBUG oslo_concurrency.processutils [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75707) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:31:57 devstack cinder-volume[75707]: DEBUG cinder.manager [None req-c200afc9-d4c9-4d8c-b4eb-9ddd4d8a28e4 None None] Notifying Schedulers of capabilities ... {{(pid=75707) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:32:03 devstack cinder-volume[75707]: DEBUG dbcounter [-] [75707] Writing DB stats cinder:SELECT=1 {{(pid=75707) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:32:03 devstack cinder-volume[75707]: DEBUG dbcounter [-] [75707] Writing DB stats cinder:UPDATE=1 {{(pid=75707) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:32:06 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Caught SIGTERM, stopping children Nov 01 09:32:06 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Acquiring lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 09:32:06 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Acquired lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 09:32:06 devstack cinder-volume[75556]: DEBUG oslo_concurrency.lockutils [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Releasing lock "singleton_lock" {{(pid=75556) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 09:32:06 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Stop services. {{(pid=75556) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 01 09:32:06 devstack cinder-volume[75556]: DEBUG oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Killing children. {{(pid=75556) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 01 09:32:06 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Waiting on 1 children to exit Nov 01 09:32:07 devstack cinder-volume[75707]: DEBUG oslo_concurrency.lockutils [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Acquiring lock "singleton_lock" {{(pid=75707) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 09:32:07 devstack cinder-volume[75707]: DEBUG oslo_concurrency.lockutils [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Acquired lock "singleton_lock" {{(pid=75707) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 09:32:07 devstack cinder-volume[75707]: DEBUG oslo_concurrency.lockutils [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Releasing lock "singleton_lock" {{(pid=75707) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 09:32:07 devstack cinder-volume[75707]: WARNING amqp [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 09:32:07 devstack cinder-volume[75707]: WARNING amqp [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 09:32:07 devstack cinder-volume[75556]: INFO oslo_service.backend._eventlet.service [None req-56ec6b97-a2dc-447b-ba0f-9ec9e606f42d None None] Child 75707 exited with status 0 Nov 01 09:32:07 devstack cinder-volume[85743]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 09:32:07 devstack cinder-volume[85743]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 09:32:07 devstack cinder-volume[85743]: we strongly recommend against using it for new projects. Nov 01 09:32:07 devstack cinder-volume[85743]: If you are already using Eventlet, we recommend migrating to a different Nov 01 09:32:07 devstack cinder-volume[85743]: framework. For more detail see Nov 01 09:32:07 devstack cinder-volume[85743]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 09:32:07 devstack cinder-volume[85743]: import eventlet # noqa Nov 01 09:32:09 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 09:32:09 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 09:32:09 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 09:32:10 devstack cinder-volume[85743]: INFO dbcounter [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Registered counter for database cinder Nov 01 09:32:10 devstack cinder-volume[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:32:10 devstack cinder-volume[85743]: DEBUG dbcounter [-] [85743] Writer thread running {{(pid=85743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 09:32:10 devstack cinder-volume[85743]: INFO cinder.rpc [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 09:32:10 devstack cinder-volume[85743]: INFO cinder.rpc [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 09:32:10 devstack cinder-volume[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:32:10 devstack cinder-volume[85743]: INFO cinder.volume.manager [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Determined volume DB was empty at startup. Nov 01 09:32:10 devstack cinder-volume[85743]: DEBUG cinder.volume.manager [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85743) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 09:32:10 devstack cinder-volume[85743]: INFO cinder.volume.manager [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 01 09:32:10 devstack cinder-volume[85743]: WARNING stevedore.named [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 09:32:10 devstack cinder-volume[85743]: WARNING castellan.key_manager [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 09:32:10 devstack cinder-volume[85743]: WARNING cinder.keymgr.conf_key_mgr [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 09:32:10 devstack cinder-volume[85743]: INFO cinder.volume.manager [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 01 09:32:10 devstack cinder-volume[85743]: DEBUG oslo_db.sqlalchemy.engines [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:32:11 devstack cinder-volume[85743]: INFO oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Starting 1 workers Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Started child 85961 {{(pid=85743) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Full set of CONF: {{(pid=85743) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] ******************************************************************************** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Configuration options gathered from: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] ================================================================================ {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] allow_availability_zone_fallback = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] allow_compression_on_image_upload = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] allowed_direct_url_schemes = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] api_rate_limit = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85961]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] auth_strategy = keystone {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_availability_zone = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_host = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_stats_polling_interval = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backup_api_class = cinder.backup.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backup_name_template = backup-%s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backup_use_same_host = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backup_use_temp_snapshot = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] chap_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] chap_username = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_internal_tenant_project_id = 5c590f6657c146fd8189ef41694ff8b7 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_internal_tenant_user_id = 8dac8261e09c4d1c81aca51df20a4122 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cluster = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] compression_format = gzip {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] compute_api_class = cinder.compute.nova.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] config_dir = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] config_source = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] control_exchange = openstack {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] debug = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] default_availability_zone = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] default_group_type = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] default_volume_type = QuobyteHD {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] disk_geometry = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] driver_client_cert = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] driver_client_cert_key = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] driver_data_namespace = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] driver_ssl_cert_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] driver_ssl_cert_verify = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] driver_use_ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] enable_new_services = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] enable_unsupported_driver = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] enabled_backends = ['QuobyteHD'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] enforce_multipath_for_image_xfer = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] filter_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_api_insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_api_servers = ['http://192.168.122.47/image'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_api_ssl_compression = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_ca_certificates_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_catalog_info = image:glance:publicURL {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_num_retries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance_request_timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] goodness_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] graceful_shutdown_timeout = 5 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] group_api_class = cinder.group.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] host = devstack {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_compress_on_upload = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_conversion_address_space_limit = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_conversion_cpu_limit = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_conversion_disable = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_introspection_address_space_limit = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_introspection_cpu_limit = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_upload_use_cinder_backend = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_upload_use_internal_tenant = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_volume_cache_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_volume_cache_max_count = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] image_volume_cache_max_size_gb = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] init_host_max_objects_retrieval = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] instance_format = [instance: %(uuid)s] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] iscsi_target_flags = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] iscsi_write_cache = on {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] iser_helper = tgtadm {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] iser_ip_address = 192.168.122.47 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85961]: INFO cinder.volume.manager [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] iser_port = 3260 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_color = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_config_append = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_dir = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_options = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.remotefs [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85961) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_rotate_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_rotate_interval_type = days {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] log_rotation_type = none {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] max_age = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] max_logfile_count = 30 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] max_logfile_size_mb = 200 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] max_over_subscription_ratio = 20.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] message_reap_interval = 86400 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] message_ttl = 2592000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] migration_create_volume_timeout_secs = 300 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] monkey_patch = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] monkey_patch_modules = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] my_ip = 192.168.122.47 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] no_snapshot_gb_quota = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] num_iser_scan_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] num_shell_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] num_volume_device_scan_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] nvmeof_conn_info_version = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] nvmet_ns_id = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] nvmet_port_id = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] osapi_max_limit = 1000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] osapi_volume_ext_list = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] osapi_volume_listen = 0.0.0.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] osapi_volume_listen_port = 8776 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] osapi_volume_use_ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] osapi_volume_workers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] per_volume_size_limit = -1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] periodic_fuzzy_delay = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] periodic_interval = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] project_id_regex = [0-9a-f\-]+ {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] public_endpoint = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] publish_errors = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] quota_backup_gigabytes = 1000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] quota_backups = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] quota_gigabytes = 1000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] quota_groups = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] quota_snapshots = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] quota_volumes = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] rate_limit_burst = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] rate_limit_except_level = CRITICAL {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] rate_limit_interval = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] reinit_driver_count = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] replication_device = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] report_discard_supported = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] report_interval = 120 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] reservation_clean_interval = 86400 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] reservation_expire = 86400 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] reserved_image_namespaces = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] reserved_percentage = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] rpc_response_timeout = 120 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] run_external_periodic_tasks = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] scst_target_driver = iscsi {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] scst_target_iqn_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_down_time = 720 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] shell_completion = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] snapshot_name_template = snapshot-%s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] state_path = /opt/stack/data/cinder {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] storage_availability_zone = nova {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] storage_protocol = iSCSI {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] syslog_log_facility = LOG_USER {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] target_helper = lioadm {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] target_ip_address = 192.168.122.47 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] target_port = 3260 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] target_protocol = iscsi {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] target_secondary_ip_addresses = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] trace_flags = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] transfer_api_class = cinder.transfer.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] transport_url = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] until_refresh = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] use_chap_auth = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] use_default_quota_class = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] use_journal = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] use_json = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] use_multipath_for_image_xfer = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] use_stderr = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] use_syslog = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] verify_glance_signatures = enabled {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_api_class = cinder.volume.api.API {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_backend_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_clear = zero {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_clear_ionice = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_clear_size = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_copy_bps_limit = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_dd_blocksize = 1M {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_name_template = volume-%s {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_service_inithost_offload = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volume_usage_audit_period = month {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] zoning_mode = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_concurrency.disable_process_locking = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85961) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 01 09:32:11 devstack cinder-volume[85961]: WARNING cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 01 09:32:11 devstack cinder-volume[85961]: WARNING cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Running cmd (subprocess): mount.quobyte {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.auth_section = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.auth_type = password {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.auth_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.cache = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.delay_auth_decision = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.http_connect_timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.include_service_catalog = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.interface = public {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcache_username = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.region_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.service_token_roles_required = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.service_type = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.token_cache_time = 300 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.47/identity {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.backend = dogpile.cache.null {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.backend_argument = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.backend_expiration_time = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.config_prefix = cache.oslo {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.debug_cache_backend = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.enable_retry_client = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.enable_socket_keepalive = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.expiration_time = 600 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.hashclient_retry_attempts = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.memcache_dead_retry = 300 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.memcache_pool_maxsize = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.memcache_sasl_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.proxies = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.redis_db = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.redis_sentinel_service_name = mymaster {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.redis_server = localhost:6379 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.retry_attempts = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.retry_delay = 0.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.socket_keepalive_count = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.socket_keepalive_idle = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.socket_keepalive_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.socket_timeout = 1.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.tls_allowed_ciphers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.tls_cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.tls_certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.tls_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.tls_keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cache.username = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] coordination.backend_url = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.asyncio_connection = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.asyncio_slave_connection = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.backend = sqlalchemy {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.connection = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.connection_debug = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.connection_parameters = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.connection_recycle_time = 3600 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.connection_trace = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.db_inc_retry_interval = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.db_max_retries = 20 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.db_max_retry_interval = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.db_retry_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.max_overflow = 50 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.max_pool_size = 5 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.max_retries = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.mysql_wsrep_sync_wait = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.pool_timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.retry_interval = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.slave_connection = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.sqlite_synchronous = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.synchronous_reader = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] database.use_db_reconnect = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_tracing.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.connection_string = messaging:// {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.es_doc_type = notification {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.es_scroll_size = 10000 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.es_scroll_time = 2m {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.filter_error_trace = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.hmac_keys = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.sentinel_service_name = mymaster {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.socket_timeout = 0.1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.trace_requests = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler.trace_sqlalchemy = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler_jaeger.process_tags = {} {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler_jaeger.service_name_prefix = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] profiler_otlp.service_name_prefix = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=85961) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.enforce_new_defaults = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.policy_default_rule = default {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85961]: INFO cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 ... Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.policy_file = policy.yaml {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_policy.remote_timeout = 60.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 -c /etc/quobyte/client-cinder.cfg {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] privsep_osbrick.group = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] privsep_osbrick.helper_command = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] privsep_osbrick.user = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_sys_admin.group = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_sys_admin.helper_command = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] cinder_sys_admin.user = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.auth_section = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.auth_type = password {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.collect_timing = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.send_service_user_token = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.tls_ciphers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] service_user.tls_min_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.auth_section = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.auth_type = password {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.collect_timing = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.region_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.tls_ciphers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] glance.tls_min_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.backend_availability_zone = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.chap_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.chap_username = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.disk_geometry = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.driver_client_cert = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.driver_client_cert_key = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.driver_data_namespace = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.driver_use_ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.enable_unsupported_driver = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.extra_capabilities = {} {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.filter_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.goodness_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.iscsi_target_flags = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.iscsi_write_cache = on {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.iser_helper = tgtadm {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.iser_ip_address = 192.168.122.47 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.iser_port = 3260 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_host = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_login = admin {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_mount_options = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_private_key = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_share_path = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_ssh_port = 22 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.num_shell_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.nvmet_port_id = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.quobyte_client_cfg = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.quobyte_volume_url = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.replication_device = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.report_discard_supported = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.reserved_percentage = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.scst_target_driver = iscsi {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.scst_target_iqn_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.storage_protocol = iSCSI {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.target_helper = tgtadm {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.target_ip_address = 192.168.122.47 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.target_port = 3260 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.target_protocol = iscsi {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.trace_flags = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.unique_fqdn_network = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.use_chap_auth = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volume_backend_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volume_clear = zero {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volume_clear_ionice = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack sudo[85967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 -c /etc/quobyte/client-cinder.cfg Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volume_clear_size = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_reports.file_event_handler = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_reports.log_dir = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.backend_availability_zone = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.backend_host = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.chap_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.chap_username = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.chiscsi_conf = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.disk_geometry = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.driver_client_cert = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.driver_client_cert_key = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.driver_data_namespace = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack sudo[85967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.driver_use_ssl = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.extra_capabilities = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.filter_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.goodness_function = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.iscsi_target_flags = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.iscsi_write_cache = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.iser_helper = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.iser_ip_address = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.iser_port = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.iser_target_prefix = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_host = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_login = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_mount_options = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_password = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_private_key = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_share_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_ssh_port = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.num_shell_tries = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nvmet_ns_id = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.nvmet_port_id = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.replication_device = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.report_discard_supported = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.reserved_percentage = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.scst_target_driver = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.storage_protocol = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.target_helper = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.target_ip_address = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.target_port = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.target_prefix = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.target_protocol = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.trace_flags = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.unique_fqdn_network = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.use_chap_auth = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volume_clear = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volume_clear_ionice = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volume_clear_size = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] QuobyteHD.volumes_dir = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.ssl_version = {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_notifications.driver = [] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_notifications.retry = -1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] oslo_messaging_notifications.transport_url = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] key_manager.fixed_key = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.barbican_api_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.barbican_endpoint = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.barbican_endpoint_type = public {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.barbican_region_name = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.collect_timing = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.number_of_retries = 60 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.retry_delay = 1 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.send_service_user_token = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.tls_ciphers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.tls_min_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.verify_ssl = True {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican.verify_ssl_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.auth_section = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.auth_type = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.cafile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.certfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.collect_timing = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.insecure = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.keyfile = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.split_loggers = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.timeout = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.tls_ciphers = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] barbican_service_user.tls_min_version = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.approle_role_id = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.approle_secret_id = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.auth_method = approle {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.auth_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.kv_mountpoint = secret {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.kv_path = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.kv_version = 2 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.namespace = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.root_token_id = **** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.ssl_ca_crt_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.timeout = 60.0 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.token_file = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.token_role = None {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.use_ssl = False {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:11 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] ******************************************************************************** {{(pid=85743) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 09:32:11 devstack sudo[85967]: pam_unix(sudo:session): session closed for user root Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.464s {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:11 devstack cinder-volume[85961]: INFO cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 succeeded Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=85961) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.477s {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:32:11 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:11 devstack sudo[86069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:32:11 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:32:12 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.237s {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:12 devstack cinder-volume[85961]: INFO cinder.volume.driver [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.volume.driver [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9102363586426, 'free_capacity_gb': 1773.9102363586426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85961) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_db.sqlalchemy.engines [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85961) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG dbcounter [-] [85961] Writer thread running {{(pid=85961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.db.api [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Building query based on filter {{(pid=85961) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.image.image_utils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85961) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 09:32:12 devstack cinder-volume[85961]: INFO cinder.keymgr.migration [None req-6afb1d3b-57a1-46e2-a0ce-8ebfbd31c817 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=85961) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=85961) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:12 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:32:12 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:32:12 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.231s {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.manager [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Notifying Schedulers of capabilities ... {{(pid=85961) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:32:12 devstack cinder-volume[85961]: INFO cinder.volume.manager [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Driver initialization completed successfully. Nov 01 09:32:12 devstack cinder-volume[85961]: INFO cinder.manager [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Initiating service 3 cleanup Nov 01 09:32:12 devstack cinder-volume[85961]: INFO cinder.manager [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Service 3 cleanup completed. Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.service [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Creating RPC server for service cinder-volume {{(pid=85961) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.service [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85961) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 09:32:12 devstack cinder-volume[85961]: INFO cinder.volume.manager [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=85961) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=85961) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:12 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:32:12 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:32:12 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Nov 01 09:32:12 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.241s {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:12 devstack cinder-volume[85961]: INFO cinder.volume.manager [None req-e5162bdb-3db2-4eba-a4fc-e4cef6a27881 None None] Driver post RPC initialization completed successfully. Nov 01 09:32:17 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-db4a5327-6fdc-4610-a1b3-761f35cbc536 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:32:17 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-db4a5327-6fdc-4610-a1b3-761f35cbc536 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:32:17 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5327-6fdc-4610-a1b3-761f35cbc536 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=85961) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:32:17 devstack cinder-volume[85961]: DEBUG cinder.volume.drivers.quobyte [None req-db4a5327-6fdc-4610-a1b3-761f35cbc536 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=85961) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:32:17 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-db4a5327-6fdc-4610-a1b3-761f35cbc536 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85961) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:32:17 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-db4a5327-6fdc-4610-a1b3-761f35cbc536 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:17 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:32:17 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:32:17 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Nov 01 09:32:17 devstack cinder-volume[85961]: DEBUG oslo_concurrency.processutils [None req-db4a5327-6fdc-4610-a1b3-761f35cbc536 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.235s {{(pid=85961) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:17 devstack cinder-volume[85961]: DEBUG cinder.manager [None req-db4a5327-6fdc-4610-a1b3-761f35cbc536 None None] Notifying Schedulers of capabilities ... {{(pid=85961) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:32:20 devstack cinder-volume[85743]: INFO oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Caught SIGTERM, stopping children Nov 01 09:32:20 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Acquiring lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 09:32:20 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Acquired lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 09:32:20 devstack cinder-volume[85743]: DEBUG oslo_concurrency.lockutils [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Releasing lock "singleton_lock" {{(pid=85743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 09:32:20 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Stop services. {{(pid=85743) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 01 09:32:20 devstack cinder-volume[85743]: DEBUG oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Killing children. {{(pid=85743) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 01 09:32:20 devstack cinder-volume[85743]: INFO oslo_service.backend._eventlet.service [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Waiting on 1 children to exit Nov 01 09:32:22 devstack cinder-volume[85961]: DEBUG dbcounter [-] [85961] Writing DB stats cinder:SELECT=3 {{(pid=85961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:32:22 devstack cinder-volume[85961]: DEBUG dbcounter [-] [85961] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85961) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:32:25 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Acquiring lock "singleton_lock" {{(pid=85961) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 09:32:25 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Acquired lock "singleton_lock" {{(pid=85961) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 09:32:25 devstack cinder-volume[85961]: DEBUG oslo_concurrency.lockutils [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Releasing lock "singleton_lock" {{(pid=85961) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 09:32:25 devstack cinder-volume[85961]: WARNING amqp [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 09:32:25 devstack cinder-volume[85961]: WARNING amqp [None req-ae9b7fbc-0687-4a61-b03a-ff29ad0d05bd None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 09:32:26 devstack cinder-volume[86308]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 09:32:26 devstack cinder-volume[86308]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 09:32:26 devstack cinder-volume[86308]: we strongly recommend against using it for new projects. Nov 01 09:32:26 devstack cinder-volume[86308]: If you are already using Eventlet, we recommend migrating to a different Nov 01 09:32:26 devstack cinder-volume[86308]: framework. For more detail see Nov 01 09:32:26 devstack cinder-volume[86308]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 09:32:26 devstack cinder-volume[86308]: import eventlet # noqa Nov 01 09:32:28 devstack cinder-volume[86308]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86308) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 09:32:28 devstack cinder-volume[86308]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86308) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 09:32:28 devstack cinder-volume[86308]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86308) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 09:32:29 devstack cinder-volume[86308]: INFO dbcounter [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Registered counter for database cinder Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_db.sqlalchemy.engines [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86308) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG dbcounter [-] [86308] Writer thread running {{(pid=86308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 09:32:29 devstack cinder-volume[86308]: INFO cinder.rpc [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 09:32:29 devstack cinder-volume[86308]: INFO cinder.rpc [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_db.sqlalchemy.engines [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86308) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:32:29 devstack cinder-volume[86308]: INFO cinder.volume.manager [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Determined volume DB was empty at startup. Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG cinder.volume.manager [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86308) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 09:32:29 devstack cinder-volume[86308]: WARNING stevedore.named [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 09:32:29 devstack cinder-volume[86308]: WARNING castellan.key_manager [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 09:32:29 devstack cinder-volume[86308]: WARNING cinder.keymgr.conf_key_mgr [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 09:32:29 devstack cinder-volume[86308]: INFO cinder.volume.manager [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_db.sqlalchemy.engines [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86308) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:32:29 devstack cinder-volume[86308]: INFO oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Starting 1 workers Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Started child 86594 {{(pid=86308) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Full set of CONF: {{(pid=86308) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] ******************************************************************************** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] Configuration options gathered from: {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] ================================================================================ {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] allow_availability_zone_fallback = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] allow_compression_on_image_upload = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] allowed_direct_url_schemes = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] api_rate_limit = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] auth_strategy = keystone {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_availability_zone = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_host = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_stats_polling_interval = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backup_api_class = cinder.backup.api.API {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backup_name_template = backup-%s {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backup_use_same_host = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86594]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backup_use_temp_snapshot = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] chap_password = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] chap_username = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_internal_tenant_project_id = 5c590f6657c146fd8189ef41694ff8b7 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_internal_tenant_user_id = 8dac8261e09c4d1c81aca51df20a4122 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cluster = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] compression_format = gzip {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] compute_api_class = cinder.compute.nova.API {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] config_dir = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] config_source = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] control_exchange = openstack {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] debug = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] default_availability_zone = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] default_group_type = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] default_volume_type = QuobyteHD {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] disk_geometry = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] driver_client_cert = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] driver_client_cert_key = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] driver_data_namespace = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:29 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] driver_ssl_cert_path = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] driver_ssl_cert_verify = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] driver_use_ssl = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] enable_new_services = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] enable_unsupported_driver = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] enabled_backends = ['QuobyteHD'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] enforce_multipath_for_image_xfer = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] filter_function = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_api_insecure = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_api_servers = ['http://192.168.122.47/image'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_api_ssl_compression = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_ca_certificates_file = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_catalog_info = image:glance:publicURL {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_certfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_keyfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_num_retries = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance_request_timeout = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] goodness_function = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] graceful_shutdown_timeout = 5 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] group_api_class = cinder.group.api.API {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] host = devstack {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_compress_on_upload = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_conversion_address_space_limit = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_conversion_cpu_limit = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_conversion_disable = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_introspection_address_space_limit = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_introspection_cpu_limit = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_upload_use_cinder_backend = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_upload_use_internal_tenant = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_volume_cache_enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_volume_cache_max_count = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] image_volume_cache_max_size_gb = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] init_host_max_objects_retrieval = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] instance_format = [instance: %(uuid)s] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] iscsi_target_flags = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] iscsi_write_cache = on {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] iser_helper = tgtadm {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] iser_ip_address = 192.168.122.47 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] iser_port = 3260 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_color = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_config_append = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_dir = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_file = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_options = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_rotate_interval = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_rotate_interval_type = days {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] log_rotation_type = none {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] max_age = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] max_logfile_count = 30 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] max_logfile_size_mb = 200 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] max_over_subscription_ratio = 20.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] message_reap_interval = 86400 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] message_ttl = 2592000 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] migration_create_volume_timeout_secs = 300 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] monkey_patch = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] monkey_patch_modules = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] my_ip = 192.168.122.47 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] no_snapshot_gb_quota = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] num_iser_scan_tries = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] num_shell_tries = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] num_volume_device_scan_tries = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] nvmeof_conn_info_version = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] nvmet_ns_id = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] nvmet_port_id = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] osapi_max_limit = 1000 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] osapi_volume_ext_list = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] osapi_volume_listen_port = 8776 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] osapi_volume_use_ssl = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] osapi_volume_workers = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] per_volume_size_limit = -1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] periodic_fuzzy_delay = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] periodic_interval = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] public_endpoint = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] publish_errors = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] quota_backup_gigabytes = 1000 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] quota_backups = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] quota_gigabytes = 1000 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] quota_groups = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] quota_snapshots = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] quota_volumes = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Starting volume driver QuobyteDriver (1.2.1) Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] rate_limit_burst = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] rate_limit_except_level = CRITICAL {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] rate_limit_interval = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86594) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] reinit_driver_count = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] replication_device = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] report_discard_supported = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] report_interval = 120 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] reservation_clean_interval = 86400 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] reservation_expire = 86400 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] reserved_image_namespaces = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] reserved_percentage = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] rpc_response_timeout = 120 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] run_external_periodic_tasks = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] scst_target_driver = iscsi {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] scst_target_iqn_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_down_time = 720 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] shell_completion = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] snapshot_name_template = snapshot-%s {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] split_loggers = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] state_path = /opt/stack/data/cinder {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] storage_availability_zone = nova {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] storage_protocol = iSCSI {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] syslog_log_facility = LOG_USER {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] target_helper = lioadm {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] target_ip_address = 192.168.122.47 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] target_port = 3260 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] target_protocol = iscsi {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] target_secondary_ip_addresses = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] trace_flags = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] transport_url = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] until_refresh = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] use_chap_auth = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] use_default_quota_class = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] use_journal = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] use_json = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] use_multipath_for_image_xfer = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] use_stderr = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] use_syslog = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] verify_glance_signatures = enabled {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_api_class = cinder.volume.api.API {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_backend_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_clear = zero {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_clear_ionice = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_clear_size = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_copy_bps_limit = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_dd_blocksize = 1M {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_name_template = volume-%s {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_service_inithost_offload = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volume_usage_audit_period = month {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] zoning_mode = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_concurrency.disable_process_locking = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.auth_section = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.auth_type = password {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.auth_version = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.cache = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.certfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.include_service_catalog = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.insecure = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.interface = public {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.keyfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_password = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcache_username = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.region_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.service_type = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.47/identity {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.backend = dogpile.cache.null {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.backend_argument = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.backend_expiration_time = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.config_prefix = cache.oslo {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.debug_cache_backend = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.enable_retry_client = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.enable_socket_keepalive = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.expiration_time = 600 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.hashclient_retry_attempts = 2 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.memcache_dead_retry = 300 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.memcache_pool_maxsize = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.memcache_sasl_enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.password = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.proxies = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.redis_db = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86594) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 01 09:32:30 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 01 09:32:30 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.redis_server = localhost:6379 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.retry_attempts = 2 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.retry_delay = 0.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Running cmd (subprocess): mount.quobyte {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.socket_keepalive_count = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.socket_keepalive_idle = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.socket_keepalive_interval = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.socket_timeout = 1.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.tls_allowed_ciphers = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.tls_cafile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.tls_certfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.tls_enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.tls_keyfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cache.username = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] coordination.backend_url = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.asyncio_connection = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.asyncio_slave_connection = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.backend = sqlalchemy {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.connection = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.connection_debug = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.connection_parameters = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.connection_recycle_time = 3600 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.connection_trace = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.db_inc_retry_interval = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.db_max_retries = 20 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.db_max_retry_interval = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.db_retry_interval = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.max_overflow = 50 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.max_pool_size = 5 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.max_retries = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.mysql_wsrep_sync_wait = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.pool_timeout = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.retry_interval = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.slave_connection = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.sqlite_synchronous = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.synchronous_reader = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] database.use_db_reconnect = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_tracing.insecure = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.connection_string = messaging:// {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.es_doc_type = notification {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.es_scroll_size = 10000 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.es_scroll_time = 2m {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.filter_error_trace = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.hmac_keys = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.sentinel_service_name = mymaster {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.socket_timeout = 0.1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.trace_requests = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler.trace_sqlalchemy = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler_jaeger.process_tags = {} {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler_jaeger.service_name_prefix = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] profiler_otlp.service_name_prefix = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.enforce_new_defaults = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.policy_default_rule = default {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.policy_file = policy.yaml {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] privsep_osbrick.group = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] privsep_osbrick.helper_command = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] privsep_osbrick.user = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_sys_admin.group = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_sys_admin.helper_command = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] cinder_sys_admin.user = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.auth_section = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.auth_type = password {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.cafile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.certfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.collect_timing = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.insecure = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.keyfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.send_service_user_token = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.split_loggers = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.timeout = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.tls_ciphers = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] service_user.tls_min_version = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.auth_section = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.auth_type = password {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.certfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.collect_timing = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.insecure = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.keyfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.region_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.split_loggers = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.timeout = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.tls_ciphers = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] glance.tls_min_version = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.backend_availability_zone = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.chap_password = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.chap_username = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.disk_geometry = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.driver_client_cert = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.driver_client_cert_key = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.driver_data_namespace = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.driver_use_ssl = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.extra_capabilities = {} {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.filter_function = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.goodness_function = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.iscsi_target_flags = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack quobyte-client[86603]: Reading configuration file: /etc/quobyte/client.cfg Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.iscsi_write_cache = on {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.iser_helper = tgtadm {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.iser_ip_address = 192.168.122.47 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.iser_port = 3260 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack quobyte-client[86603]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_host = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_login = admin {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_mount_options = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_password = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_private_key = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_share_path = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.num_shell_tries = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.quobyte_volume_url = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.replication_device = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.report_discard_supported = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.reserved_percentage = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.target_helper = tgtadm {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.target_ip_address = 192.168.122.47 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.target_port = 3260 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.target_protocol = iscsi {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.trace_flags = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.unique_fqdn_network = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.use_chap_auth = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volume_backend_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volume_clear = zero {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volume_clear_ionice = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volume_clear_size = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_reports.file_event_handler = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_reports.log_dir = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.backend_availability_zone = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.backend_host = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.chap_password = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.chap_username = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.chiscsi_conf = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.disk_geometry = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.driver_client_cert = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.driver_data_namespace = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.driver_use_ssl = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.extra_capabilities = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.filter_function = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.goodness_function = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.iser_helper = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.iser_ip_address = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.iser_port = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.iser_target_prefix = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_host = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_login = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_mount_options = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_password = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_private_key = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_share_path = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_ssh_port = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.num_shell_tries = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.nvmet_port_id = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack sudo[86607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.replication_device = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.report_discard_supported = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.reserved_percentage = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.scst_target_driver = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack sudo[86607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.storage_protocol = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.target_helper = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.target_ip_address = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.target_port = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.target_prefix = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.target_protocol = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.trace_flags = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.use_chap_auth = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volume_clear = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volume_clear_size = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] QuobyteHD.volumes_dir = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.ssl = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_notifications.driver = [] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_notifications.retry = -1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] key_manager.fixed_key = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.barbican_api_version = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.barbican_endpoint = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.barbican_endpoint_type = public {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.barbican_region_name = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.cafile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.certfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.collect_timing = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.insecure = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.keyfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.number_of_retries = 60 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.retry_delay = 1 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.send_service_user_token = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.split_loggers = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.timeout = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.tls_ciphers = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.tls_min_version = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.verify_ssl = True {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican.verify_ssl_path = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.auth_section = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.auth_type = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.cafile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.certfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.collect_timing = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.insecure = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.keyfile = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.split_loggers = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.timeout = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.tls_ciphers = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] barbican_service_user.tls_min_version = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.approle_role_id = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.approle_secret_id = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.auth_method = approle {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.auth_path = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.kv_mountpoint = secret {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.kv_path = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.kv_version = 2 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.namespace = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.root_token_id = **** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.ssl_ca_crt_file = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.timeout = 60.0 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.token_file = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.token_role = None {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.use_ssl = False {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 09:32:30 devstack cinder-volume[86308]: DEBUG oslo_service.backend._eventlet.service [None req-744b2c41-1854-4acc-9391-82f24f986e42 None None] ******************************************************************************** {{(pid=86308) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 09:32:30 devstack sudo[86607]: pam_unix(sudo:session): session closed for user root Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.283s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:30 devstack cinder-volume[86594]: INFO cinder.volume.driver [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Driver hasn't implemented _init_vendor_properties() Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.driver [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9102363586426, 'free_capacity_gb': 1773.9102363586426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86594) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_db.sqlalchemy.engines [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86594) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writer thread running {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.db.api [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Building query based on filter {{(pid=86594) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86594) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:30 devstack cinder-volume[86594]: INFO cinder.keymgr.migration [None req-60f3a2b8-41fd-4536-83b8-e8af3e3ec3fd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 09:32:30 devstack sudo[86620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:32:30 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:32:30 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.225s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:32:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Driver initialization completed successfully. Nov 01 09:32:30 devstack cinder-volume[86594]: INFO cinder.manager [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Initiating service 3 cleanup Nov 01 09:32:30 devstack cinder-volume[86594]: INFO cinder.manager [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Service 3 cleanup completed. Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.service [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Creating RPC server for service cinder-volume {{(pid=86594) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.service [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86594) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 09:32:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:32:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:32:30 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:32:30 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:32:31 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Nov 01 09:32:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.249s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:32:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2ea7b549-0745-4140-836d-3f99b2bb706c None None] Driver post RPC initialization completed successfully. Nov 01 09:32:39 devstack cinder-volume[86308]: DEBUG dbcounter [-] [86308] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86308) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:32:40 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:32:41 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:32:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:32:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 6 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:32:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:33:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:33:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:33:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:33:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:33:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:33:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:33:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:33:53 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:33:53 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:33:54 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Nov 01 09:33:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.833s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:33:54 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:33:54 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:33:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 6 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:33:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Flow 'volume_create_manager' (5be70ac2-f2c6-4530-b475-6baac237d3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858af038-f6bf-4575-b085-44fc39b7fb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858af038-f6bf-4575-b085-44fc39b7fb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2028885197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc237847-7700-41c9-a9f0-8ecd352a893e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f256c71280cd403a9c49795f629c2c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:33:58Z,use_quota=True,user_id='e6e23e3e4090445587182a1359130d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745462fa-ffe9-4ddc-b338-8346e78485db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745462fa-ffe9-4ddc-b338-8346e78485db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510d6d33-122a-4450-9f5e-b051c6512598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510d6d33-122a-4450-9f5e-b051c6512598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc237847-7700-41c9-a9f0-8ecd352a893e', 'volume_name': 'volume-fc237847-7700-41c9-a9f0-8ecd352a893e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dd36db-a145-460c-8e74-a1c95e32e80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dd36db-a145-460c-8e74-a1c95e32e80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8782933-4baa-47e9-be99-c0f502498b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:33:58 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Volume fc237847-7700-41c9-a9f0-8ecd352a893e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc237847-7700-41c9-a9f0-8ecd352a893e', 'volume_size': 1} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2028885197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc237847-7700-41c9-a9f0-8ecd352a893e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f256c71280cd403a9c49795f629c2c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:33:58Z,use_quota=True,user_id='e6e23e3e4090445587182a1359130d08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Creating volume fc237847-7700-41c9-a9f0-8ecd352a893e {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:33:58 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:33:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:33:58 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e 1073741824 Nov 01 09:33:58 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:00 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e 1073741824" returned: 0 in 1.594s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:00 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e Nov 01 09:34:00 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:00 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8782933-4baa-47e9-be99-c0f502498b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc237847-7700-41c9-a9f0-8ecd352a893e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4827f95e-233c-4229-a3b4-bf21c8eccc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:00 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Volume volume-fc237847-7700-41c9-a9f0-8ecd352a893e (fc237847-7700-41c9-a9f0-8ecd352a893e): created successfully Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4827f95e-233c-4229-a3b4-bf21c8eccc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Flow 'volume_create_manager' (5be70ac2-f2c6-4530-b475-6baac237d3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:00 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6cac17d2-dbc4-4e58-a41b-f701e5d86d8c tempest-VolumesAdminNegativeTest-1943183107 None] Created volume successfully. Nov 01 09:34:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Acquiring lock "cinder-fc237847-7700-41c9-a9f0-8ecd352a893e-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Lock "cinder-fc237847-7700-41c9-a9f0-8ecd352a893e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Acquiring lock "cinder-quobyte-fc237847-7700-41c9-a9f0-8ecd352a893e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Lock "cinder-quobyte-fc237847-7700-41c9-a9f0-8ecd352a893e" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:02 devstack cinder-volume[86594]: INFO oslo.privsep.daemon [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr9ye9yfa/privsep.sock'] Nov 01 09:34:02 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr9ye9yfa/privsep.sock Nov 01 09:34:02 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: Nov 01 09:34:03 devstack cinder-volume[86594]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 01 09:34:04 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:04 devstack cinder-volume[86594]: INFO oslo.privsep.daemon [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Spawned new privsep daemon via rootwrap Nov 01 09:34:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Accepted privsep connection to /tmp/tmpr9ye9yfa/privsep.sock {{(pid=86594) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 01 09:34:04 devstack cinder-volume[86594]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 01 09:34:04 devstack cinder-volume[86594]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 01 09:34:04 devstack cinder-volume[86594]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 01 09:34:04 devstack cinder-volume[86594]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87881 Nov 01 09:34:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d7a8e2-f998-41db-a2db-51512141a298]: (2,) {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4010396-7803-46a5-baab-a0cc930999c0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:04 devstack sudo[87883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e Nov 01 09:34:04 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:04 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e" returned: 0 in 0.650s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:04 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e Nov 01 09:34:04 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:05 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fc237847-7700-41c9-a9f0-8ecd352a893e" returned: 0 in 0.444s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Lock "cinder-quobyte-fc237847-7700-41c9-a9f0-8ecd352a893e" released by "delete_volume" :: held 3.001s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:05 devstack cinder-volume[86594]: WARNING cinder.quota [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:34:05 devstack cinder-volume[86594]: WARNING cinder.quota [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Created reservations ['06cc187b-a51a-47ca-ad15-44b5f896be50', '75e972bb-e0ec-46bd-b5b4-47a5b4e54dd4', '900b4e30-1207-4e6d-9070-f6ac6d958670', '963cc9d1-9d04-492f-a153-9551db6ea93f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:05 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:34:05 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Flow 'volume_create_manager' (7fe9f162-2336-4674-a209-5cfc883148ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346fa4f3-ecfe-49e5-bdf3-edfc72bbaa4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346fa4f3-ecfe-49e5-bdf3-edfc72bbaa4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1321115854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1721446-ec03-4ff0-9dfd-15ce804eebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a54c519ea04813b1e5796b880b4b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:06Z,use_quota=True,user_id='69222d730a1c47f29396a4522704f90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95f9f59-9a9c-4a27-899c-514970d724ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95f9f59-9a9c-4a27-899c-514970d724ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa5aa99-dbd4-49bc-8cf0-b536b943d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa5aa99-dbd4-49bc-8cf0-b536b943d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1721446-ec03-4ff0-9dfd-15ce804eebfb', 'volume_name': 'volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff25f70a-de77-4337-9c55-b513518f04e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff25f70a-de77-4337-9c55-b513518f04e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c10b306-2aff-4b28-afdc-9d7215870f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:06 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Volume a1721446-ec03-4ff0-9dfd-15ce804eebfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb', 'volume_size': 1} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1321115854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1721446-ec03-4ff0-9dfd-15ce804eebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a54c519ea04813b1e5796b880b4b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:06Z,use_quota=True,user_id='69222d730a1c47f29396a4522704f90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Creating volume a1721446-ec03-4ff0-9dfd-15ce804eebfb {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:34:06 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:06 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.613s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:34:06 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb 1073741824 Nov 01 09:34:06 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Deleted volume successfully. Nov 01 09:34:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24479600-3a02-4365-a688-352a1e58f383 tempest-VolumesAdminNegativeTest-1943183107 None] Lock "cinder-fc237847-7700-41c9-a9f0-8ecd352a893e-delete_volume" released by "delete_volume" :: held 4.251s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:07 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb 1073741824" returned: 0 in 1.058s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:07 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb Nov 01 09:34:07 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:07 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb" returned: 0 in 0.549s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:34:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c10b306-2aff-4b28-afdc-9d7215870f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93824061-51ea-4960-af50-44a5dd75e197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:08 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Volume volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb (a1721446-ec03-4ff0-9dfd-15ce804eebfb): created successfully Nov 01 09:34:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93824061-51ea-4960-af50-44a5dd75e197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Flow 'volume_create_manager' (7fe9f162-2336-4674-a209-5cfc883148ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:08 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-496bd330-6d15-4efe-91b9-5ec3ca7e061c tempest-ServersNegativeTestJSON-229971351 None] Created volume successfully. Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Flow 'volume_create_manager' (b0732b6b-a50c-4458-80e5-ca28873003d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c083de-32fb-403c-955f-a625f165b944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95c083de-32fb-403c-955f-a625f165b944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1940079824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704e9ae1-8e6f-4f6c-b761-3231a6f95802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146ff96417654df9b0f92f37c3f77a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:11Z,use_quota=True,user_id='40dd6fbacb2b46ad9b3fef9e3e8a27c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004fe7c4-5e42-45ad-b001-da08560af68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (004fe7c4-5e42-45ad-b001-da08560af68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e281b7-580f-4471-903e-1d1f14600dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e281b7-580f-4471-903e-1d1f14600dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '704e9ae1-8e6f-4f6c-b761-3231a6f95802', 'volume_name': 'volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d186b9-94b6-4a51-ac2f-9318130769c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d186b9-94b6-4a51-ac2f-9318130769c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426834bc-d5a5-4f88-8e71-408c76dafbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:11 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Volume 704e9ae1-8e6f-4f6c-b761-3231a6f95802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802', 'volume_size': 1} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1940079824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=704e9ae1-8e6f-4f6c-b761-3231a6f95802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146ff96417654df9b0f92f37c3f77a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:11Z,use_quota=True,user_id='40dd6fbacb2b46ad9b3fef9e3e8a27c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Creating volume 704e9ae1-8e6f-4f6c-b761-3231a6f95802 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:34:11 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:11 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 1073741824 Nov 01 09:34:11 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:11 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 1073741824" returned: 0 in 0.495s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:11 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 Nov 01 09:34:11 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:12 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802" returned: 0 in 0.361s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426834bc-d5a5-4f88-8e71-408c76dafbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4cdd27-4025-40f6-b898-d4a74135808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Volume volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 (704e9ae1-8e6f-4f6c-b761-3231a6f95802): created successfully Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4cdd27-4025-40f6-b898-d4a74135808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Flow 'volume_create_manager' (b0732b6b-a50c-4458-80e5-ca28873003d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:12 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6db075ec-d4d9-4019-b1c4-c02147a25b61 tempest-ServerActionsTestOtherA-1951790121 None] Created volume successfully. Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Flow 'volume_create_manager' (b42a5fca-fe0f-43f5-a450-7f5c47d03502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52dc159d-2983-41a2-b78e-69497386d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52dc159d-2983-41a2-b78e-69497386d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1314201178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbfb0c0-e8e0-4337-a885-ea59f23d2347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a54c519ea04813b1e5796b880b4b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:13Z,use_quota=True,user_id='69222d730a1c47f29396a4522704f90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4101333-0e79-4a6d-98e0-27cd0188732e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4101333-0e79-4a6d-98e0-27cd0188732e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5675fd07-5e02-4a7d-b8ba-f5c646deef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5675fd07-5e02-4a7d-b8ba-f5c646deef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fbfb0c0-e8e0-4337-a885-ea59f23d2347', 'volume_name': 'volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652b68fb-1e10-4e6b-89d5-73fd741fceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (652b68fb-1e10-4e6b-89d5-73fd741fceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98c5a8c-7c4f-44c4-bc3b-146d07b94e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Volume 3fbfb0c0-e8e0-4337-a885-ea59f23d2347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347', 'volume_size': 1} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1314201178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbfb0c0-e8e0-4337-a885-ea59f23d2347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a54c519ea04813b1e5796b880b4b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:13Z,use_quota=True,user_id='69222d730a1c47f29396a4522704f90b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Creating volume 3fbfb0c0-e8e0-4337-a885-ea59f23d2347 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:34:12 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:34:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:12 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 1073741824 Nov 01 09:34:12 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:13 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 1073741824" returned: 0 in 0.473s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:13 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 Nov 01 09:34:13 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:13 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347" returned: 0 in 0.293s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98c5a8c-7c4f-44c4-bc3b-146d07b94e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12967cfe-238b-4517-8f8a-f466694f3df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Volume volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 (3fbfb0c0-e8e0-4337-a885-ea59f23d2347): created successfully Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12967cfe-238b-4517-8f8a-f466694f3df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Flow 'volume_create_manager' (b42a5fca-fe0f-43f5-a450-7f5c47d03502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:13 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-74d00546-5660-405c-b7ea-cfb949c36ad8 tempest-ServersNegativeTestJSON-229971351 None] Created volume successfully. Nov 01 09:34:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "cinder-3fbfb0c0-e8e0-4337-a885-ea59f23d2347-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Lock "cinder-3fbfb0c0-e8e0-4337-a885-ea59f23d2347-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "cinder-quobyte-3fbfb0c0-e8e0-4337-a885-ea59f23d2347" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Lock "cinder-quobyte-3fbfb0c0-e8e0-4337-a885-ea59f23d2347" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[897534cf-e283-47a1-8b1c-fb1733a7d7da]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:17 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 Nov 01 09:34:17 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:17 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347" returned: 0 in 0.502s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:17 devstack sudo[87967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347 Nov 01 09:34:17 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:18 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3fbfb0c0-e8e0-4337-a885-ea59f23d2347" returned: 0 in 0.271s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Lock "cinder-quobyte-3fbfb0c0-e8e0-4337-a885-ea59f23d2347" released by "delete_volume" :: held 0.833s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Created reservations ['1b496475-db34-4429-8b79-f625464c94fd', '5df589b1-d2e0-420a-bf04-8c1258e65709', '1fc0f592-96d4-4bb2-94f5-eb23a68f51db', '9f176abc-ec76-4a53-847d-75a2a5728324'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:18 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:34:18 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "cinder-a1721446-ec03-4ff0-9dfd-15ce804eebfb-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Lock "cinder-a1721446-ec03-4ff0-9dfd-15ce804eebfb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "cinder-quobyte-a1721446-ec03-4ff0-9dfd-15ce804eebfb" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Lock "cinder-quobyte-a1721446-ec03-4ff0-9dfd-15ce804eebfb" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f76bf1-7973-452f-85ab-dcdb984156fd]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:18 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.376s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:34:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Deleted volume successfully. Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a9c21d3-76aa-4b65-8919-ce6d2d05128d tempest-ServersNegativeTestJSON-229971351 None] Lock "cinder-3fbfb0c0-e8e0-4337-a885-ea59f23d2347-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:18 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb Nov 01 09:34:18 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:18 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb" returned: 0 in 0.412s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:18 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb Nov 01 09:34:18 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:19 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1721446-ec03-4ff0-9dfd-15ce804eebfb" returned: 0 in 0.278s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Lock "cinder-quobyte-a1721446-ec03-4ff0-9dfd-15ce804eebfb" released by "delete_volume" :: held 0.755s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Created reservations ['3250a717-8d07-4b33-9c98-6657a504cb0a', '486966d1-806a-4dbf-9d73-56ffad13a58f', '687d20c4-7988-4eee-a008-47ae78796506', 'd9ceaaab-3e65-4a78-9c70-3bec04f6684b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:19 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:34:19 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:19 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.279s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:34:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Deleted volume successfully. Nov 01 09:34:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8622f2c4-de88-415f-9cb3-13c4f3416117 tempest-ServersNegativeTestJSON-229971351 None] Lock "cinder-a1721446-ec03-4ff0-9dfd-15ce804eebfb-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:29 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:34:29 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=27,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=9 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Flow 'volume_create_manager' (6a84d499-1262-49a4-bb12-22ea6d4f5154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a529ad-92bc-4fdf-8b87-7ae5b3c31c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a529ad-92bc-4fdf-8b87-7ae5b3c31c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-827933045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f014cd-899d-4560-9a4b-908f967c46ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb5b163c9a84ef293c43daaf842ef43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:39Z,use_quota=True,user_id='8932d52a13fc414db32ac6c7517256ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e588b256-4ee0-45da-ad63-2e511581431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e588b256-4ee0-45da-ad63-2e511581431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02edeba-c882-406d-9984-15aeba47d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02edeba-c882-406d-9984-15aeba47d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14f014cd-899d-4560-9a4b-908f967c46ba', 'volume_name': 'volume-14f014cd-899d-4560-9a4b-908f967c46ba', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e1d301-8d08-4858-8683-b3438ea08eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6e1d301-8d08-4858-8683-b3438ea08eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955aa272-9173-415c-aaab-75ebc51c0bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:39 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Volume 14f014cd-899d-4560-9a4b-908f967c46ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14f014cd-899d-4560-9a4b-908f967c46ba', 'volume_size': 1} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-827933045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f014cd-899d-4560-9a4b-908f967c46ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb5b163c9a84ef293c43daaf842ef43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:39Z,use_quota=True,user_id='8932d52a13fc414db32ac6c7517256ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Creating volume 14f014cd-899d-4560-9a4b-908f967c46ba {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:34:39 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:34:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:39 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba 1073741824 Nov 01 09:34:39 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:40 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba 1073741824" returned: 0 in 0.999s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:40 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba Nov 01 09:34:40 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e4dfda-4db1-407f-98a1-85c612027d59 tempest-BackendsCapabilitiesAdminTestsJSON-284660952 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9102363586426, 'free_capacity_gb': 1773.9102363586426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86594) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 09:34:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e97deb71-fa9f-4ba8-837b-0d07d0277493 tempest-BackendsCapabilitiesAdminTestsJSON-284660952 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9102363586426, 'free_capacity_gb': 1773.9102363586426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86594) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 09:34:41 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba" returned: 0 in 0.526s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:34:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (955aa272-9173-415c-aaab-75ebc51c0bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f014cd-899d-4560-9a4b-908f967c46ba', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c28fda1-6cca-40a7-bad4-aabbe59da975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:41 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Volume volume-14f014cd-899d-4560-9a4b-908f967c46ba (14f014cd-899d-4560-9a4b-908f967c46ba): created successfully Nov 01 09:34:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c28fda1-6cca-40a7-bad4-aabbe59da975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Flow 'volume_create_manager' (6a84d499-1262-49a4-bb12-22ea6d4f5154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e2d33c7d-dc81-41cc-af8b-4a0ece7a4561 tempest-DeleteServersTestJSON-430089624 None] Created volume successfully. Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Flow 'volume_create_manager' (88b44c06-0ab1-4c96-8fdc-1a0bfbcbd1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c165dc3-91b8-4d23-bec1-cd3b7ef97426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c165dc3-91b8-4d23-bec1-cd3b7ef97426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-152041300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887a0bb1-9335-4967-89e6-4cd9f443ad02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf080f5fad5483fbff0ba2ba24ebf46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:44Z,use_quota=True,user_id='8105e6e45f92457fb9b6afba08f748fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdea8656-f9b0-4433-9489-3bdf7511c53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdea8656-f9b0-4433-9489-3bdf7511c53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1259cf-951a-4c99-bf16-664dededde39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e1259cf-951a-4c99-bf16-664dededde39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887a0bb1-9335-4967-89e6-4cd9f443ad02', 'volume_name': 'volume-887a0bb1-9335-4967-89e6-4cd9f443ad02', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26ba372-1a4e-4fd8-90f0-1bf3895979f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26ba372-1a4e-4fd8-90f0-1bf3895979f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a018cabd-2ff6-49cc-a790-5b42358398cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:44 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Volume 887a0bb1-9335-4967-89e6-4cd9f443ad02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887a0bb1-9335-4967-89e6-4cd9f443ad02', 'volume_size': 1} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-152041300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887a0bb1-9335-4967-89e6-4cd9f443ad02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cf080f5fad5483fbff0ba2ba24ebf46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:44Z,use_quota=True,user_id='8105e6e45f92457fb9b6afba08f748fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Creating volume 887a0bb1-9335-4967-89e6-4cd9f443ad02 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:34:44 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:34:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:44 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 1073741824 Nov 01 09:34:44 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:45 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 1073741824" returned: 0 in 0.710s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:45 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 Nov 01 09:34:45 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:45 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02" returned: 0 in 0.582s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a018cabd-2ff6-49cc-a790-5b42358398cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887a0bb1-9335-4967-89e6-4cd9f443ad02', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c18401b-0809-4fa8-8861-261978c45677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:45 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Volume volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 (887a0bb1-9335-4967-89e6-4cd9f443ad02): created successfully Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c18401b-0809-4fa8-8861-261978c45677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Flow 'volume_create_manager' (88b44c06-0ab1-4c96-8fdc-1a0bfbcbd1e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-306bbe47-f937-40ad-b995-5c05e5231441 req-db1f1066-9d29-4690-965b-a017496fa6b3 tempest-VolumesSnapshotsTestJSON-409597310 None] Created volume successfully. Nov 01 09:34:46 devstack cinder-volume[86594]: WARNING py.warnings [req-d845b7a4-fc21-4f25-9660-6b2938fa214e req-8e8030ab-89cf-4225-bb61-4429467d0a42 tempest-DeleteServersTestJSON-430089624 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 01 09:34:46 devstack cinder-volume[86594]: .first() Nov 01 09:34:46 devstack cinder-volume[86594]: Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-d845b7a4-fc21-4f25-9660-6b2938fa214e req-8e8030ab-89cf-4225-bb61-4429467d0a42 tempest-DeleteServersTestJSON-430089624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-d845b7a4-fc21-4f25-9660-6b2938fa214e req-8e8030ab-89cf-4225-bb61-4429467d0a42 tempest-DeleteServersTestJSON-430089624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-d845b7a4-fc21-4f25-9660-6b2938fa214e req-8e8030ab-89cf-4225-bb61-4429467d0a42 tempest-DeleteServersTestJSON-430089624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Creating offline snapshot 767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 of volume 887a0bb1-9335-4967-89e6-4cd9f443ad02 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-d845b7a4-fc21-4f25-9660-6b2938fa214e req-8e8030ab-89cf-4225-bb61-4429467d0a42 tempest-DeleteServersTestJSON-430089624 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-14f014cd-899d-4560-9a4b-908f967c46ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ad438b9-472a-4951-8bd2-0affbfae5931', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aff7b5d-0d88-4ba8-b1b2-ebe65765ec18]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:47 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 Nov 01 09:34:47 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:47 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-d845b7a4-fc21-4f25-9660-6b2938fa214e req-8e8030ab-89cf-4225-bb61-4429467d0a42 tempest-DeleteServersTestJSON-430089624 None] attachment_update completed successfully. Nov 01 09:34:47 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02" returned: 0 in 0.736s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:47 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 1G Nov 01 09:34:47 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:48 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 1G" returned: 0 in 0.676s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:48 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 Nov 01 09:34:48 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:49 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3" returned: 0 in 0.471s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:49 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 is being set with open permissions: ugo+rw Nov 01 09:34:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:49 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 Nov 01 09:34:49 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:49 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3" returned: 0 in 0.451s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:49 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.info Nov 01 09:34:49 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:50 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.info" returned: 0 in 0.476s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:50 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.info is being set with open permissions: ugo+rw Nov 01 09:34:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:50 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.info Nov 01 09:34:50 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:50 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.info" returned: 0 in 0.434s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.468s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-18135271-7eb7-4997-bad6-2ccbeb67da99 req-496435ce-987c-4587-ae94-fe036c298d2f tempest-VolumesSnapshotsTestJSON-409597310 None] Create snapshot completed successfully Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "cinder-767246ff-2285-4a3d-b43c-f7d2d3f2b8f3-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-767246ff-2285-4a3d-b43c-f7d2d3f2b8f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "cinder-quobyte-887a0bb1-9335-4967-89e6-4cd9f443ad02" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-quobyte-887a0bb1-9335-4967-89e6-4cd9f443ad02" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "cinder-quobyte-767246ff-2285-4a3d-b43c-f7d2d3f2b8f3" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-quobyte-767246ff-2285-4a3d-b43c-f7d2d3f2b8f3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Deleting offline snapshot 767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 of volume 887a0bb1-9335-4967-89e6-4cd9f443ad02 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] snapshot_file for this snap is: volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d543d2-1da8-457c-9d31-cab9ec889ac0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:51 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 Nov 01 09:34:51 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-29e46afe-a098-4795-89c9-81933c58774e req-b4f42e5d-ef35-4e4c-9015-c1713bc9df1a tempest-DeleteServersTestJSON-430089624 None] Terminate volume connection completed successfully. Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-29e46afe-a098-4795-89c9-81933c58774e req-b4f42e5d-ef35-4e4c-9015-c1713bc9df1a tempest-DeleteServersTestJSON-430089624 None] Deleting attachment 1ad438b9-472a-4951-8bd2-0affbfae5931. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:34:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d1eec921-21da-4ace-ba00-cc3ef29331ec tempest-GroupSnapshotsTest-1538292768 None] Group tempest-GroupSnapshotsTest-Group-1874372280: creating Nov 01 09:34:51 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3" returned: 0 in 0.554s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-887a0bb1-9335-4967-89e6-4cd9f443ad02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b07672b-d89c-4240-9089-6d66eca3db9c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d1eec921-21da-4ace-ba00-cc3ef29331ec tempest-GroupSnapshotsTest-1538292768 None] Group tempest-GroupSnapshotsTest-Group-1874372280: created successfully Nov 01 09:34:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d1eec921-21da-4ace-ba00-cc3ef29331ec tempest-GroupSnapshotsTest-1538292768 None] Create group completed successfully. Nov 01 09:34:51 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 Nov 01 09:34:51 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:52 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02" returned: 0 in 0.366s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:52 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 Nov 01 09:34:52 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:52 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3" returned: 0 in 0.322s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:52 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3 Nov 01 09:34:52 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:52 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02.767246ff-2285-4a3d-b43c-f7d2d3f2b8f3" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-quobyte-767246ff-2285-4a3d-b43c-f7d2d3f2b8f3" released by "_delete_snapshot" :: held 1.637s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-quobyte-887a0bb1-9335-4967-89e6-4cd9f443ad02" released by "delete_snapshot" :: held 1.668s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:52 devstack cinder-volume[86594]: WARNING cinder.quota [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG cinder.quota [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Created reservations ['18575eed-c7c0-4ff8-b847-04036a79ebca', '6d1418a0-9bfb-4393-b94a-eda9f10670a6', '68a04fb9-c83f-457a-8308-06b9c5ae204c', '21c13516-e1a5-4c4b-8936-04e08ea1a7cf'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:34:52 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Delete snapshot completed successfully. Nov 01 09:34:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-7052bd6c-4c08-4310-a4fa-1040e5ae3f18 req-367f1d48-b867-40ed-94e0-fc8bb55a75fe tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-767246ff-2285-4a3d-b43c-f7d2d3f2b8f3-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Acquiring lock "cinder-14f014cd-899d-4560-9a4b-908f967c46ba-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:53 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Lock "cinder-14f014cd-899d-4560-9a4b-908f967c46ba-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:53 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Acquiring lock "cinder-quobyte-14f014cd-899d-4560-9a4b-908f967c46ba" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Lock "cinder-quobyte-14f014cd-899d-4560-9a4b-908f967c46ba" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6cd262-c3eb-4aa8-8e94-fe588d8a2bd9]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Flow 'volume_create_manager' (d98618d1-a18e-4c7d-bf6a-85ef36f5774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b3073f-3230-4534-afc0-6061112e503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "cinder-887a0bb1-9335-4967-89e6-4cd9f443ad02-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b3073f-3230-4534-afc0-6061112e503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-421736691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63e74ae7-7148-4882-b96f-e5246204a881,host='devstack@QuobyteHD#QuobyteHD',id=8f0193ed-332f-4fff-84cc-17f01186a0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a1ed50324490980affe979404fb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:53Z,use_quota=True,user_id='ffb7d4fb59334ed39126a53e9341c7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaf61be4-5333-4814-9948-2e63a17d0b62),volume_type_id=eaf61be4-5333-4814-9948-2e63a17d0b62)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b8bd69-ff49-4540-810a-d5b771122ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b8bd69-ff49-4540-810a-d5b771122ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b74a0fd-f74f-4757-a95e-edbc16ae0f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b74a0fd-f74f-4757-a95e-edbc16ae0f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0193ed-332f-4fff-84cc-17f01186a0a4', 'volume_name': 'volume-8f0193ed-332f-4fff-84cc-17f01186a0a4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bb81d2-6675-4743-8e6b-2598a8d30442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1bb81d2-6675-4743-8e6b-2598a8d30442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b5c388-286f-405c-9937-785c6aae366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:53 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Volume 8f0193ed-332f-4fff-84cc-17f01186a0a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0193ed-332f-4fff-84cc-17f01186a0a4', 'volume_size': 1} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63e74ae7-7148-4882-b96f-e5246204a881,created_at=2026-11-01T08:34:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-421736691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63e74ae7-7148-4882-b96f-e5246204a881,host='devstack@QuobyteHD#QuobyteHD',id=8f0193ed-332f-4fff-84cc-17f01186a0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a1ed50324490980affe979404fb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:53Z,use_quota=True,user_id='ffb7d4fb59334ed39126a53e9341c7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eaf61be4-5333-4814-9948-2e63a17d0b62),volume_type_id=eaf61be4-5333-4814-9948-2e63a17d0b62)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Creating volume 8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:34:53 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-887a0bb1-9335-4967-89e6-4cd9f443ad02-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:53 devstack sudo[88835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba Nov 01 09:34:53 devstack sudo[88835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:53 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 1073741824 Nov 01 09:34:53 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:53 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.377s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "cinder-quobyte-887a0bb1-9335-4967-89e6-4cd9f443ad02" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-quobyte-887a0bb1-9335-4967-89e6-4cd9f443ad02" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[74958cbe-4549-4645-8749-99bbc04bb877]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:53 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 Nov 01 09:34:53 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:53 devstack sudo[88835]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba" returned: 0 in 0.471s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:53 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba Nov 01 09:34:53 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:54 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 1073741824" returned: 0 in 0.456s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:54 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02" returned: 0 in 0.381s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:54 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 Nov 01 09:34:54 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:54 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02 Nov 01 09:34:54 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:54 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-14f014cd-899d-4560-9a4b-908f967c46ba" returned: 0 in 0.276s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Lock "cinder-quobyte-14f014cd-899d-4560-9a4b-908f967c46ba" released by "delete_volume" :: held 0.804s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Created reservations ['0bef4f4c-f913-4d4e-b295-7f91c219d1e2', 'ee1e9aaf-f05a-4dae-8fa5-26086d92d830', '2c07bf32-e03a-460a-9cbd-eeae11c584b3', 'ad9848c9-ea4f-40f4-90b7-8f46e98af392'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:54 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:34:54 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:54 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4" returned: 0 in 0.247s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5b5c388-286f-405c-9937-785c6aae366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0193ed-332f-4fff-84cc-17f01186a0a4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e5199a-68ac-4128-b3d0-f1303c4e79c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:54 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Volume volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 (8f0193ed-332f-4fff-84cc-17f01186a0a4): created successfully Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e5199a-68ac-4128-b3d0-f1303c4e79c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Flow 'volume_create_manager' (d98618d1-a18e-4c7d-bf6a-85ef36f5774a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:54 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e6987193-9491-4c4a-9a41-0c1676d64e5f tempest-GroupSnapshotsTest-1538292768 None] Created volume successfully. Nov 01 09:34:54 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-887a0bb1-9335-4967-89e6-4cd9f443ad02" returned: 0 in 0.309s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-quobyte-887a0bb1-9335-4967-89e6-4cd9f443ad02" released by "delete_volume" :: held 0.759s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.quota [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Created reservations ['7618345f-1aca-426f-a844-74bf41e1d34c', 'e51e035d-51bd-492f-b324-65edad00b172', 'c9343725-e0f6-4f38-907b-72b65eba55ee', '5c71afd4-5ff3-4bc3-a144-af8cc2540119'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:54 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:34:54 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Deleted volume successfully. Nov 01 09:34:54 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:34:54 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e71fc55e-e890-44d9-b9a3-44ac0f03510b tempest-DeleteServersTestJSON-430089624 None] Lock "cinder-14f014cd-899d-4560-9a4b-908f967c46ba-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:54 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.manager [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:34:54 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Deleted volume successfully. Nov 01 09:34:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-b4a379e9-a27c-4303-9ff2-34ef43ca412b req-f94b1698-ddb5-442d-aeb0-4a22738b9e57 tempest-VolumesSnapshotsTestJSON-409597310 None] Lock "cinder-887a0bb1-9335-4967-89e6-4cd9f443ad02-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:34:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] GroupSnapshot 2c741e60-791e-4945-a0fe-cf0b0ccd4a59: creating. Nov 01 09:34:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Group snapshot 2c741e60-791e-4945-a0fe-cf0b0ccd4a59: creating. {{(pid=86594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 09:34:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Creating offline snapshot a34942aa-2050-41e6-9590-9933fd2ccf48 of volume 8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:34:55 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1a99b9-5deb-4f65-a924-76e948abf605]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:34:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:55 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 Nov 01 09:34:55 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:55 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4" returned: 0 in 0.456s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:55 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 1G Nov 01 09:34:55 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:56 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 1G" returned: 0 in 0.454s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:56 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 Nov 01 09:34:56 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:56 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48" returned: 0 in 0.358s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:56 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:34:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:56 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 Nov 01 09:34:56 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:56 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48" returned: 0 in 0.295s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:56 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.info Nov 01 09:34:56 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:57 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.info" returned: 0 in 0.277s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:57 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:34:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:57 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.info Nov 01 09:34:57 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:57 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Nov 01 09:34:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.info" returned: 0 in 0.309s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:34:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:57 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d4297145-e84f-4782-9434-fa6f9a2db049 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot 2c741e60-791e-4945-a0fe-cf0b0ccd4a59: created successfully Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Flow 'volume_create_manager' (7ae9f985-239b-4d68-bd3e-4e3f6f27363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192e846b-2bce-416d-b878-908ef63586c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (192e846b-2bce-416d-b878-908ef63586c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1411189667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a404b8d5-4b0c-4a71-83ed-4b0c5c691555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='318f836099e049ef99c26795db004faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:59Z,use_quota=True,user_id='16907d4738224f0b9276d4ab01b66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204835ed-1b65-4793-87bc-48e7719e1ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204835ed-1b65-4793-87bc-48e7719e1ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8968a12a-db21-43d0-a764-df5357d3ec6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8968a12a-db21-43d0-a764-df5357d3ec6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a404b8d5-4b0c-4a71-83ed-4b0c5c691555', 'volume_name': 'volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e5664e-9c6b-4e36-b948-ede3a4c1a4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e5664e-9c6b-4e36-b948-ede3a4c1a4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8366f6e7-4ab3-4bab-9801-5d8e9baf209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:34:59 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Volume a404b8d5-4b0c-4a71-83ed-4b0c5c691555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555', 'volume_size': 1} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1411189667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a404b8d5-4b0c-4a71-83ed-4b0c5c691555,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='318f836099e049ef99c26795db004faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:34:59Z,use_quota=True,user_id='16907d4738224f0b9276d4ab01b66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Creating volume a404b8d5-4b0c-4a71-83ed-4b0c5c691555 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:34:59 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:34:59 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 1073741824 Nov 01 09:34:59 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:34:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:00 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 1073741824" returned: 0 in 0.773s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:00 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 Nov 01 09:35:00 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:00 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555" returned: 0 in 0.279s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.712s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-a34942aa-2050-41e6-9590-9933fd2ccf48-0b2f482f-cbb9-4898-b117-23eea590682e" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-a34942aa-2050-41e6-9590-9933fd2ccf48-0b2f482f-cbb9-4898-b117-23eea590682e" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Creating volume 0b2f482f-cbb9-4898-b117-23eea590682e from snapshot a34942aa-2050-41e6-9590-9933fd2ccf48 {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-0b2f482f-cbb9-4898-b117-23eea590682e" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8366f6e7-4ab3-4bab-9801-5d8e9baf209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ebd542-410e-477f-9ee9-9b5c9a13ebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-0b2f482f-cbb9-4898-b117-23eea590682e" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] snapshot: a34942aa-2050-41e6-9590-9933fd2ccf48, volume: 0b2f482f-cbb9-4898-b117-23eea590682e, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:35:00 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Volume volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 (a404b8d5-4b0c-4a71-83ed-4b0c5c691555): created successfully Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9ebd542-410e-477f-9ee9-9b5c9a13ebc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Flow 'volume_create_manager' (7ae9f985-239b-4d68-bd3e-4e3f6f27363a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:00 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0704cafc-3668-458d-a9b2-a69d44e59e0e tempest-VolumesTestJSON-21092975 None] Created volume successfully. Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd01e78b-eb0f-465a-80c0-072f954946f0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:00 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 Nov 01 09:35:00 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:01 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48" returned: 0 in 0.393s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0193ed-332f-4fff-84cc-17f01186a0a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79cdd77-644c-4f8b-82f0-6deb9e6dd166]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:01 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 Nov 01 09:35:01 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:01 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4" returned: 0 in 0.429s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:35:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:01 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e Nov 01 09:35:01 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6072de22-07e7-4ee4-9e18-f765cca4a903 req-8c9ed0c6-b3fa-44b5-baf3-726dc295382f tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Flow 'volume_create_manager' (40f93bc1-38d8-482b-a4e5-a85be19b5dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09667db2-86d5-4120-85f2-616f47d30bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09667db2-86d5-4120-85f2-616f47d30bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758475793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33389c5-bd8c-4c4c-b77f-63ed7cf578e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='318f836099e049ef99c26795db004faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:02Z,use_quota=True,user_id='16907d4738224f0b9276d4ab01b66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebee90ea-9083-47ba-9436-02a61c07a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebee90ea-9083-47ba-9436-02a61c07a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f48f55-7013-4d1f-bbf6-9ff54ce42da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f48f55-7013-4d1f-bbf6-9ff54ce42da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a33389c5-bd8c-4c4c-b77f-63ed7cf578e0', 'volume_name': 'volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df491813-7b61-4ed7-8505-5b6b583994c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df491813-7b61-4ed7-8505-5b6b583994c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c43c77-22ee-4aff-bd24-dfa7d89bcd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:02 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Volume a33389c5-bd8c-4c4c-b77f-63ed7cf578e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0', 'volume_size': 1} Nov 01 09:35:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:08 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e" returned: 0 in 7.303s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:08 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:35:08 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Converted 1024.00 MB image at 140.19 MB/s Nov 01 09:35:08 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:08 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e Nov 01 09:35:08 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:09 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e" returned: 0 in 0.247s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-0b2f482f-cbb9-4898-b117-23eea590682e" released by "_copy_volume_from_snapshot" :: held 8.530s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-a34942aa-2050-41e6-9590-9933fd2ccf48-0b2f482f-cbb9-4898-b117-23eea590682e" released by "_create_volume_from_snapshot" :: held 8.615s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.644s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6072de22-07e7-4ee4-9e18-f765cca4a903 req-8c9ed0c6-b3fa-44b5-baf3-726dc295382f tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.204s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6072de22-07e7-4ee4-9e18-f765cca4a903 req-8c9ed0c6-b3fa-44b5-baf3-726dc295382f tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.805s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758475793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33389c5-bd8c-4c4c-b77f-63ed7cf578e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='318f836099e049ef99c26795db004faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:02Z,use_quota=True,user_id='16907d4738224f0b9276d4ab01b66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Creating volume a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:09 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:09 devstack sudo[88966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 1073741824 Nov 01 09:35:09 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-6072de22-07e7-4ee4-9e18-f765cca4a903 req-8c9ed0c6-b3fa-44b5-baf3-726dc295382f tempest-ServerActionsTestOtherA-1951790121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '439cd3bd-f26a-4f0c-b00f-eeff2c9d10c3', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:35:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-18a5a95a-7362-45f4-8fd6-845df9946d0c tempest-GroupSnapshotsTest-1538292768 None] Create group from source-snapshot-2c741e60-791e-4945-a0fe-cf0b0ccd4a59 completed successfully. Nov 01 09:35:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-6072de22-07e7-4ee4-9e18-f765cca4a903 req-8c9ed0c6-b3fa-44b5-baf3-726dc295382f tempest-ServerActionsTestOtherA-1951790121 None] attachment_update completed successfully. Nov 01 09:35:09 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 1073741824" returned: 0 in 0.608s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:09 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 Nov 01 09:35:09 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:10 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c43c77-22ee-4aff-bd24-dfa7d89bcd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c2dbb2-4185-456b-8d2c-3e0dff01367b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:10 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Volume volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 (a33389c5-bd8c-4c4c-b77f-63ed7cf578e0): created successfully Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c2dbb2-4185-456b-8d2c-3e0dff01367b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Flow 'volume_create_manager' (40f93bc1-38d8-482b-a4e5-a85be19b5dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-0b2f482f-cbb9-4898-b117-23eea590682e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a33b1454-7131-4d96-859b-a45e61f3918d tempest-VolumesTestJSON-21092975 None] Created volume successfully. Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-0b2f482f-cbb9-4898-b117-23eea590682e" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7258b9a6-9b82-4440-a0ce-39c1152dd70e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:10 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e Nov 01 09:35:10 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:10 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e" returned: 0 in 0.401s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:10 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e Nov 01 09:35:10 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:11 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0b2f482f-cbb9-4898-b117-23eea590682e" returned: 0 in 0.367s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-0b2f482f-cbb9-4898-b117-23eea590682e" released by "delete_volume" :: held 0.834s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['6952e5b6-1cd4-48d0-9e56-055306827863'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:11 devstack cinder-volume[86594]: WARNING cinder.quota [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1658284247 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1658284247, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:11 devstack cinder-volume[86594]: WARNING cinder.quota [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1658284247 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1658284247, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['f50f1a00-9352-4517-a6f7-555864a7d8cd', '8ba10f74-cdec-4c2a-8a50-1426b57d5704', 'd6198e91-f380-4eb4-85e9-957676232ef2', '973a9db6-6bd9-432e-a0b8-c1402d10b126'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:11 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:11 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot 2c741e60-791e-4945-a0fe-cf0b0ccd4a59: deleting Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot 2c741e60-791e-4945-a0fe-cf0b0ccd4a59: deleting {{(pid=86594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-8f0193ed-332f-4fff-84cc-17f01186a0a4" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-8f0193ed-332f-4fff-84cc-17f01186a0a4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-a34942aa-2050-41e6-9590-9933fd2ccf48" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:11 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-a34942aa-2050-41e6-9590-9933fd2ccf48" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Deleting offline snapshot a34942aa-2050-41e6-9590-9933fd2ccf48 of volume 8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] snapshot_file for this snap is: volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Flow 'volume_create_manager' (c3b21a0b-0d7c-4de7-ac8e-21a9e2d99ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3955f5f5-14f8-4933-bfb5-35b349a9148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0b5d40-7dd6-4142-96db-71b62d6cf5ee]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.438s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bb1b7bed-7233-4481-a612-205893745a82 tempest-GroupSnapshotsTest-1538292768 None] Delete group completed successfully. Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3955f5f5-14f8-4933-bfb5-35b349a9148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1606323961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b11f0a-5a73-4e72-82bc-588166a3c82f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='318f836099e049ef99c26795db004faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:12Z,use_quota=True,user_id='16907d4738224f0b9276d4ab01b66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce18e199-1bba-4486-86d3-591a360c68b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce18e199-1bba-4486-86d3-591a360c68b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959db83a-0a90-4106-a64b-b29e4f278b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959db83a-0a90-4106-a64b-b29e4f278b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b11f0a-5a73-4e72-82bc-588166a3c82f', 'volume_name': 'volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1669360d-e892-4026-8fa6-0501aaf9606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1669360d-e892-4026-8fa6-0501aaf9606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1019bee-9256-469d-aafc-0078701a1085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Volume e3b11f0a-5a73-4e72-82bc-588166a3c82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f', 'volume_size': 1} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1606323961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b11f0a-5a73-4e72-82bc-588166a3c82f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='318f836099e049ef99c26795db004faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:12Z,use_quota=True,user_id='16907d4738224f0b9276d4ab01b66015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Creating volume e3b11f0a-5a73-4e72-82bc-588166a3c82f {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:12 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:12 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f 1073741824 Nov 01 09:35:12 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:12 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 Nov 01 09:35:12 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:12 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48" returned: 0 in 0.537s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0193ed-332f-4fff-84cc-17f01186a0a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcb397b-bdc1-4add-8d65-1d76200a1481]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:12 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f 1073741824" returned: 0 in 0.634s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:12 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 Nov 01 09:35:12 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:12 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f Nov 01 09:35:12 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:13 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f" returned: 0 in 0.311s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1019bee-9256-469d-aafc-0078701a1085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7104660-45b9-4740-b3ed-be55dffa1d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Volume volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f (e3b11f0a-5a73-4e72-82bc-588166a3c82f): created successfully Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7104660-45b9-4740-b3ed-be55dffa1d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Flow 'volume_create_manager' (c3b21a0b-0d7c-4de7-ac8e-21a9e2d99ced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:13 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1d811a9c-2d65-464f-8b96-6cecd7ac6867 tempest-VolumesTestJSON-21092975 None] Created volume successfully. Nov 01 09:35:13 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4" returned: 0 in 0.724s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:13 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 Nov 01 09:35:13 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:13 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48" returned: 0 in 0.371s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:13 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48 Nov 01 09:35:13 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:13 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-b8ae818e-b04e-401e-93cf-740a28cbba29 req-25768f74-6c6e-463b-a747-742dd57b12ad tempest-ServerActionsTestOtherA-1951790121 None] Terminate volume connection completed successfully. Nov 01 09:35:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-b8ae818e-b04e-401e-93cf-740a28cbba29 req-25768f74-6c6e-463b-a747-742dd57b12ad tempest-ServerActionsTestOtherA-1951790121 None] Deleting attachment 439cd3bd-f26a-4f0c-b00f-eeff2c9d10c3. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:35:14 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4.a34942aa-2050-41e6-9590-9933fd2ccf48" returned: 0 in 0.429s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-a34942aa-2050-41e6-9590-9933fd2ccf48" released by "_delete_snapshot" :: held 2.265s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-8f0193ed-332f-4fff-84cc-17f01186a0a4" released by "delete_snapshot" :: held 2.342s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:14 devstack cinder-volume[86594]: WARNING cinder.quota [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1658284247 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1658284247, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:14 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['31f3896d-8d3e-4166-b8c9-8567a7a8dbb4', 'feceda79-b920-4416-8565-12a829dcd48e', '32fc2fe0-328a-40f9-9592-532d46df4aa2', 'a04444ca-6c20-4c3c-a153-cc555b3484aa'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9b1a26ef-cbec-4c94-8b04-e7ea28c589f8 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot 2c741e60-791e-4945-a0fe-cf0b0ccd4a59: deleted successfully Nov 01 09:35:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-b8ae818e-b04e-401e-93cf-740a28cbba29 req-b30d5f5e-5327-4772-a963-5c35365caf6b tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-b8ae818e-b04e-401e-93cf-740a28cbba29 req-b30d5f5e-5327-4772-a963-5c35365caf6b tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-b8ae818e-b04e-401e-93cf-740a28cbba29 req-b30d5f5e-5327-4772-a963-5c35365caf6b tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-b8ae818e-b04e-401e-93cf-740a28cbba29 req-b30d5f5e-5327-4772-a963-5c35365caf6b tempest-ServerActionsTestOtherA-1951790121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49d7cf70-daff-403a-bf82-b3962855cfac', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:35:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-b8ae818e-b04e-401e-93cf-740a28cbba29 req-b30d5f5e-5327-4772-a963-5c35365caf6b tempest-ServerActionsTestOtherA-1951790121 None] attachment_update completed successfully. Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Acquiring lock "cinder-e3b11f0a-5a73-4e72-82bc-588166a3c82f-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Lock "cinder-e3b11f0a-5a73-4e72-82bc-588166a3c82f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Acquiring lock "cinder-quobyte-e3b11f0a-5a73-4e72-82bc-588166a3c82f" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Lock "cinder-quobyte-e3b11f0a-5a73-4e72-82bc-588166a3c82f" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[56191dca-c584-455c-b3f7-4cedd67653e7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-8f0193ed-332f-4fff-84cc-17f01186a0a4" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-8f0193ed-332f-4fff-84cc-17f01186a0a4" acquired by "delete_volume" :: waited 0.036s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:15 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f Nov 01 09:35:15 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fabc2e0-9ab4-450e-9f04-73832b7b8c27]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:15 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 Nov 01 09:35:15 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:16 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f" returned: 0 in 0.590s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:16 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f Nov 01 09:35:16 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:16 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4" returned: 0 in 0.521s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:16 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4 Nov 01 09:35:16 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:16 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3b11f0a-5a73-4e72-82bc-588166a3c82f" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Lock "cinder-quobyte-e3b11f0a-5a73-4e72-82bc-588166a3c82f" released by "delete_volume" :: held 0.956s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Created reservations ['4e7e282a-d1da-4f53-9d79-68bcfa35299e', '1ead6137-d109-4d4d-ac9c-6b51a89e9c1b', '478b9e7c-98a4-42e3-bfad-63394654461b', 'cfe6541f-366e-49e1-a261-d4c856480c42'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:16 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:16 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:16 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8f0193ed-332f-4fff-84cc-17f01186a0a4" returned: 0 in 0.369s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-8f0193ed-332f-4fff-84cc-17f01186a0a4" released by "delete_volume" :: held 0.991s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:16 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['41e90ec6-122d-4340-ba8a-73868d8b0bf9'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:17 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.415s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Deleted volume successfully. Nov 01 09:35:17 devstack cinder-volume[86594]: WARNING cinder.db.api [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1658284247'] Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['486dbb04-ab06-4cfd-826d-e7566cbeb989', '7ac57b8c-30e8-4103-8676-3202ea9b1c38', '1d9775eb-ebe5-4ff2-ab3c-64a45ff13887', '498f4091-c548-4779-ba42-fae4803b5195'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1431740c-c6a2-4c96-a1ba-e072fa494733 tempest-VolumesTestJSON-21092975 None] Lock "cinder-e3b11f0a-5a73-4e72-82bc-588166a3c82f-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:17 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:17 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:17 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.304s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a1842cff-9b71-4538-a176-1f30540a5bb9 tempest-GroupSnapshotsTest-1538292768 None] Delete group completed successfully. Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Acquiring lock "cinder-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Lock "cinder-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Acquiring lock "cinder-quobyte-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Lock "cinder-quobyte-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa384e1-0c59-4bf3-bf7e-12662ee33bc0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:17 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 Nov 01 09:35:17 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:18 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0" returned: 0 in 0.426s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:18 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0 Nov 01 09:35:18 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:18 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0" returned: 0 in 0.285s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Lock "cinder-quobyte-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0" released by "delete_volume" :: held 0.786s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Created reservations ['9e631c7a-b7b4-4f4f-a5c1-842409591280', 'a4611d66-6269-438f-bb74-c0ee378118dd', '4407235e-1822-4641-a14b-fa72e91fea1b', 'c15f7e08-8a4e-4f0a-a21c-1f1963cd3afd'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:18 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:18 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Acquiring lock "cinder-a404b8d5-4b0c-4a71-83ed-4b0c5c691555-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Lock "cinder-a404b8d5-4b0c-4a71-83ed-4b0c5c691555-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Acquiring lock "cinder-quobyte-a404b8d5-4b0c-4a71-83ed-4b0c5c691555" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Lock "cinder-quobyte-a404b8d5-4b0c-4a71-83ed-4b0c5c691555" acquired by "delete_volume" :: waited 0.043s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09e90c6-1942-439d-9348-13b7359c6fe9]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:19 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.485s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Deleted volume successfully. Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98184a6b-a978-4879-927f-dae5747ae3fe tempest-VolumesTestJSON-21092975 None] Lock "cinder-a33389c5-bd8c-4c4c-b77f-63ed7cf578e0-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ca72cbed-f322-45e6-9d1b-cd75f43d4d99 tempest-GroupSnapshotsTest-1538292768 None] Group tempest-GroupSnapshotsTest-Group-2058644898: creating Nov 01 09:35:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ca72cbed-f322-45e6-9d1b-cd75f43d4d99 tempest-GroupSnapshotsTest-1538292768 None] Group tempest-GroupSnapshotsTest-Group-2058644898: created successfully Nov 01 09:35:19 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 Nov 01 09:35:19 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ca72cbed-f322-45e6-9d1b-cd75f43d4d99 tempest-GroupSnapshotsTest-1538292768 None] Create group completed successfully. Nov 01 09:35:19 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555" returned: 0 in 0.728s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:19 devstack sudo[90006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555 Nov 01 09:35:19 devstack sudo[90006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:20 devstack sudo[90006]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a404b8d5-4b0c-4a71-83ed-4b0c5c691555" returned: 0 in 0.467s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Lock "cinder-quobyte-a404b8d5-4b0c-4a71-83ed-4b0c5c691555" released by "delete_volume" :: held 1.308s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Created reservations ['0d874877-8ee6-4984-aeed-24d5137de19c', '4ded8d83-d995-4728-88c4-51ed17c205ee', 'dd7bd655-5cc3-45a8-b0b7-56ffa3efba7b', 'dee35fea-40b9-414a-829d-4ed69ff6a69a'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:20 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:20 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:21 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.387s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Deleted volume successfully. Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94230c92-f11b-4f24-863e-a3d593811568 tempest-VolumesTestJSON-21092975 None] Lock "cinder-a404b8d5-4b0c-4a71-83ed-4b0c5c691555-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Flow 'volume_create_manager' (91dd98a4-d1fa-4093-89aa-4f8e1ccde88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f162b64f-82d6-4436-967b-8284ba7d06b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f162b64f-82d6-4436-967b-8284ba7d06b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-711360549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be43f16a-9c3b-41bb-a9bc-89e440f4da37,host='devstack@QuobyteHD#QuobyteHD',id=7619d5ee-8185-4ee2-9e85-3c5180b8a3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a1ed50324490980affe979404fb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:21Z,use_quota=True,user_id='ffb7d4fb59334ed39126a53e9341c7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9e52b0-2d1f-48a3-b05f-6e095f0e93ac),volume_type_id=0a9e52b0-2d1f-48a3-b05f-6e095f0e93ac)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dace6f24-665a-4ace-ac59-4d896ad2ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dace6f24-665a-4ace-ac59-4d896ad2ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef27e44-799b-44b5-b5d4-97cec4d4379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef27e44-799b-44b5-b5d4-97cec4d4379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7619d5ee-8185-4ee2-9e85-3c5180b8a3e5', 'volume_name': 'volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136742e0-e267-432e-a98a-6d3d947a78af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136742e0-e267-432e-a98a-6d3d947a78af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90644d6b-3604-4e08-aad5-9cee5a8a15a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:21 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Volume 7619d5ee-8185-4ee2-9e85-3c5180b8a3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5', 'volume_size': 1} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be43f16a-9c3b-41bb-a9bc-89e440f4da37,created_at=2026-11-01T08:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-711360549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be43f16a-9c3b-41bb-a9bc-89e440f4da37,host='devstack@QuobyteHD#QuobyteHD',id=7619d5ee-8185-4ee2-9e85-3c5180b8a3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a1ed50324490980affe979404fb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:21Z,use_quota=True,user_id='ffb7d4fb59334ed39126a53e9341c7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9e52b0-2d1f-48a3-b05f-6e095f0e93ac),volume_type_id=0a9e52b0-2d1f-48a3-b05f-6e095f0e93ac)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Creating volume 7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:21 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:35:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:21 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 1073741824 Nov 01 09:35:21 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:22 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 1073741824" returned: 0 in 0.671s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:22 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 Nov 01 09:35:22 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:22 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" returned: 0 in 0.513s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90644d6b-3604-4e08-aad5-9cee5a8a15a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03be6a19-d829-47ee-9999-e0340daa5201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:22 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Volume volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 (7619d5ee-8185-4ee2-9e85-3c5180b8a3e5): created successfully Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03be6a19-d829-47ee-9999-e0340daa5201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Flow 'volume_create_manager' (91dd98a4-d1fa-4093-89aa-4f8e1ccde88f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-55bedf31-c139-497e-a550-220fa56742ff tempest-GroupSnapshotsTest-1538292768 None] Created volume successfully. Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Flow 'volume_create_manager' (4d19a5a7-4a9e-49e0-98e9-9436d9c57cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e06530-c5f7-4e88-bf49-94aac2e793b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e06530-c5f7-4e88-bf49-94aac2e793b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1417366687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be43f16a-9c3b-41bb-a9bc-89e440f4da37,host='devstack@QuobyteHD#QuobyteHD',id=69a67d4d-7073-447e-94bb-d11d240c0db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a1ed50324490980affe979404fb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:25Z,use_quota=True,user_id='ffb7d4fb59334ed39126a53e9341c7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9e52b0-2d1f-48a3-b05f-6e095f0e93ac),volume_type_id=0a9e52b0-2d1f-48a3-b05f-6e095f0e93ac)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b221a829-4476-4326-9fc0-8b3b16776e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b221a829-4476-4326-9fc0-8b3b16776e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9574cf6-76bd-4bf9-80b7-462ff83238a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9574cf6-76bd-4bf9-80b7-462ff83238a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a67d4d-7073-447e-94bb-d11d240c0db7', 'volume_name': 'volume-69a67d4d-7073-447e-94bb-d11d240c0db7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81594f25-7f33-4796-ab5d-6a13b229a9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81594f25-7f33-4796-ab5d-6a13b229a9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9e258e-56bd-4036-85e6-c6817b5fc055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:24 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Volume 69a67d4d-7073-447e-94bb-d11d240c0db7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a67d4d-7073-447e-94bb-d11d240c0db7', 'volume_size': 1} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=be43f16a-9c3b-41bb-a9bc-89e440f4da37,created_at=2026-11-01T08:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1417366687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=be43f16a-9c3b-41bb-a9bc-89e440f4da37,host='devstack@QuobyteHD#QuobyteHD',id=69a67d4d-7073-447e-94bb-d11d240c0db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a1ed50324490980affe979404fb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:25Z,use_quota=True,user_id='ffb7d4fb59334ed39126a53e9341c7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9e52b0-2d1f-48a3-b05f-6e095f0e93ac),volume_type_id=0a9e52b0-2d1f-48a3-b05f-6e095f0e93ac)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Creating volume 69a67d4d-7073-447e-94bb-d11d240c0db7 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:24 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:35:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:25 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 1073741824 Nov 01 09:35:25 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:25 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 1073741824" returned: 0 in 0.534s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:25 devstack sudo[90032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 Nov 01 09:35:25 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:25 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee9e258e-56bd-4036-85e6-c6817b5fc055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a67d4d-7073-447e-94bb-d11d240c0db7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92cc4ac-7112-400a-b4ca-6fc81b8c4c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:25 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Volume volume-69a67d4d-7073-447e-94bb-d11d240c0db7 (69a67d4d-7073-447e-94bb-d11d240c0db7): created successfully Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92cc4ac-7112-400a-b4ca-6fc81b8c4c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Flow 'volume_create_manager' (4d19a5a7-4a9e-49e0-98e9-9436d9c57cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-dba9f428-6d31-460d-934b-8468a6ce9f9d tempest-GroupSnapshotsTest-1538292768 None] Created volume successfully. Nov 01 09:35:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8389a9c5-6e94-4e86-92ca-4168d01b2343 tempest-GroupSnapshotsTest-1538292768 None] Update group completed successfully. Nov 01 09:35:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-350eeca3-d31e-4ece-ac02-a55408d3cf27 tempest-GroupsV314Test-286269182 None] Group tempest-GroupsV314Test-Group-994618862: creating Nov 01 09:35:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-350eeca3-d31e-4ece-ac02-a55408d3cf27 tempest-GroupsV314Test-286269182 None] Group tempest-GroupsV314Test-Group-994618862: created successfully Nov 01 09:35:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-350eeca3-d31e-4ece-ac02-a55408d3cf27 tempest-GroupsV314Test-286269182 None] Create group completed successfully. Nov 01 09:35:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4f4d2523-747e-4e07-a4aa-b2eda78d56de tempest-GroupSnapshotsTest-1538292768 None] Update group completed successfully. Nov 01 09:35:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-69fc24f3-9fb8-488c-b33c-91a8b955a044 tempest-GroupSnapshotsTest-1538292768 None] Update group completed successfully. Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Flow 'volume_create_manager' (0acb27bd-41b1-437e-be57-36309e0ecef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98171448-a771-4f13-b7e4-921c92894244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98171448-a771-4f13-b7e4-921c92894244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706875207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65a70cac-98fb-490a-8347-d6607270efc0,host='devstack@QuobyteHD#QuobyteHD',id=b9a41f26-9a84-41d2-81d3-23a59f41f3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d7c8d9d21945a89425a370920b1d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:29Z,use_quota=True,user_id='6b6248b30f134c23947fce535d21a0e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d60de89-b1c7-4b81-b343-bc530c946d13),volume_type_id=0d60de89-b1c7-4b81-b343-bc530c946d13)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dbe855-8845-468d-afe5-fdd13a37b58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dbe855-8845-468d-afe5-fdd13a37b58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2166ec54-8119-417f-8123-45ed8bc04635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2166ec54-8119-417f-8123-45ed8bc04635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a41f26-9a84-41d2-81d3-23a59f41f3d6', 'volume_name': 'volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110d9f72-ebf5-4b10-8dbe-a08a8137fdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110d9f72-ebf5-4b10-8dbe-a08a8137fdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b494eb6-f090-4488-9ac5-0cbc5c4f979c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:29 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Volume b9a41f26-9a84-41d2-81d3-23a59f41f3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6', 'volume_size': 1} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=65a70cac-98fb-490a-8347-d6607270efc0,created_at=2026-11-01T08:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706875207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=65a70cac-98fb-490a-8347-d6607270efc0,host='devstack@QuobyteHD#QuobyteHD',id=b9a41f26-9a84-41d2-81d3-23a59f41f3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d7c8d9d21945a89425a370920b1d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:29Z,use_quota=True,user_id='6b6248b30f134c23947fce535d21a0e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d60de89-b1c7-4b81-b343-bc530c946d13),volume_type_id=0d60de89-b1c7-4b81-b343-bc530c946d13)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Creating volume b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:29 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:29 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 1073741824 Nov 01 09:35:29 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:29 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 1073741824" returned: 0 in 0.561s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=102,cinder:SELECT=130,cinder:INSERT=20,cinder:DELETE=11 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:35:29 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=108,cinder:UPDATE=127,cinder:INSERT=29,cinder:DELETE=3 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:35:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:30 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 Nov 01 09:35:30 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-75f4a951-63d0-477a-ba8f-e3c5cbf597f2 tempest-GroupSnapshotsTest-1538292768 None] Update group completed successfully. Nov 01 09:35:30 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" returned: 0 in 0.380s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b494eb6-f090-4488-9ac5-0cbc5c4f979c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69de0984-0da2-4fd1-900a-070460bb37f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Volume volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 (b9a41f26-9a84-41d2-81d3-23a59f41f3d6): created successfully Nov 01 09:35:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69de0984-0da2-4fd1-900a-070460bb37f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Flow 'volume_create_manager' (0acb27bd-41b1-437e-be57-36309e0ecef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5b719db9-8bad-4e25-8ff8-87dfbc5ea61e tempest-GroupsV314Test-286269182 None] Created volume successfully. Nov 01 09:35:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] GroupSnapshot db29bcb4-ebd0-4b9a-b1e9-73a841e94614: creating. Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Group snapshot db29bcb4-ebd0-4b9a-b1e9-73a841e94614: creating. {{(pid=86594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Creating offline snapshot 8ff41a2e-8972-4aa2-870d-3a7461d915f0 of volume 7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba49579-5d0e-4daa-88db-3226b41e7ad8]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:32 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 Nov 01 09:35:32 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:32 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" returned: 0 in 0.566s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:32 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 1G Nov 01 09:35:32 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:33 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 1G" returned: 0 in 0.452s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:33 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 Nov 01 09:35:33 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:33 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:33 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:33 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 Nov 01 09:35:33 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:33 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:33 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.info Nov 01 09:35:33 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:34 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.info" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:34 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:34 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.info Nov 01 09:35:34 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:34 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.info" returned: 0 in 0.292s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Creating offline snapshot e0c53c2d-5b88-4ead-a492-2121635bcc9c of volume 69a67d4d-7073-447e-94bb-d11d240c0db7 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fefa9c-08c3-42f7-9c53-1ba7b5c91fed]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:34 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 Nov 01 09:35:34 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:34 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7" returned: 0 in 0.416s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:34 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c 1G Nov 01 09:35:34 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:35 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c 1G" returned: 0 in 0.441s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69a67d4d-7073-447e-94bb-d11d240c0db7 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:35 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69a67d4d-7073-447e-94bb-d11d240c0db7 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c Nov 01 09:35:35 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:35 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69a67d4d-7073-447e-94bb-d11d240c0db7 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c" returned: 0 in 0.316s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:35 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:35 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c Nov 01 09:35:35 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:35 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c" returned: 0 in 0.267s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:35 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.info Nov 01 09:35:35 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:36 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.info" returned: 0 in 0.260s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:36 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:36 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.info Nov 01 09:35:36 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:36 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.info" returned: 0 in 0.259s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.966s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:36 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Cloning volume b9a41f26-9a84-41d2-81d3-23a59f41f3d6 to volume c43b0f1e-b7be-4459-94de-676c41b3a3e9 Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Creating offline snapshot a2dfbb2b-1cfc-484c-a610-c239ac722da3 of volume b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d606d9a4-b480-4bec-99bb-13dde86a6d8e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-058c6d67-067f-4d29-942e-dc3f46afdff5 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot db29bcb4-ebd0-4b9a-b1e9-73a841e94614: created successfully Nov 01 09:35:36 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 Nov 01 09:35:36 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:36 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" returned: 0 in 0.408s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:37 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 1G Nov 01 09:35:37 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:37 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 1G" returned: 0 in 0.474s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:37 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 Nov 01 09:35:37 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot db29bcb4-ebd0-4b9a-b1e9-73a841e94614: deleting Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot db29bcb4-ebd0-4b9a-b1e9-73a841e94614: deleting {{(pid=86594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-8ff41a2e-8972-4aa2-870d-3a7461d915f0" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-8ff41a2e-8972-4aa2-870d-3a7461d915f0" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Deleting offline snapshot 8ff41a2e-8972-4aa2-870d-3a7461d915f0 of volume 7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] snapshot_file for this snap is: volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b958d923-3b86-43a7-b19b-a5b1fde7958a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Flow 'volume_create_manager' (9e99dcea-f0f1-4ffb-9bdb-d7c697bae1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fb5b01-af72-4fd4-89e1-def54c9156c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:37 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 Nov 01 09:35:37 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79fb5b01-af72-4fd4-89e1-def54c9156c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1649854259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f034b1c7-d838-4f43-8c70-3ac45ee1cf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687e7c01e55a428c954f7845bc64ceec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:38Z,use_quota=True,user_id='bab7b6a5a3a54d0a83937d2af694d7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f3c847-b742-4490-916d-7758560832f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f3c847-b742-4490-916d-7758560832f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c9eacd-cfe4-4d3e-b8f6-c617bd9434ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c9eacd-cfe4-4d3e-b8f6-c617bd9434ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f034b1c7-d838-4f43-8c70-3ac45ee1cf1d', 'volume_name': 'volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1115724b-aa67-4860-aeb2-13364157011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1115724b-aa67-4860-aeb2-13364157011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d4e721-08bc-4ad7-be51-08cb321668b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:38 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Volume f034b1c7-d838-4f43-8c70-3ac45ee1cf1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d', 'volume_size': 1} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:38 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3" returned: 0 in 0.567s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:38 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:38 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 Nov 01 09:35:38 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:38 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0" returned: 0 in 0.431s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:35:38 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d218e459-5c26-4a81-b3b9-7d18fce0f068]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3" returned: 0 in 0.271s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:38 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.info Nov 01 09:35:38 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:38 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 Nov 01 09:35:38 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:38 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.info" returned: 0 in 0.267s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:38 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:38 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.info Nov 01 09:35:38 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:38 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" returned: 0 in 0.359s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:38 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 Nov 01 09:35:38 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:38 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.info" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Acquiring lock "cinder-quobyte-c43b0f1e-b7be-4459-94de-676c41b3a3e9" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Lock "cinder-quobyte-c43b0f1e-b7be-4459-94de-676c41b3a3e9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] snapshot: a2dfbb2b-1cfc-484c-a610-c239ac722da3, volume: c43b0f1e-b7be-4459-94de-676c41b3a3e9, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00c871b-c3c8-4fc8-b415-18f17e1c18d8]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:38 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0" returned: 0 in 0.345s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:39 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0 Nov 01 09:35:39 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:39 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 Nov 01 09:35:39 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:39 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5.8ff41a2e-8972-4aa2-870d-3a7461d915f0" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-8ff41a2e-8972-4aa2-870d-3a7461d915f0" released by "_delete_snapshot" :: held 1.605s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" released by "delete_snapshot" :: held 1.653s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:39 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3" returned: 0 in 0.400s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-69a67d4d-7073-447e-94bb-d11d240c0db7" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e60412a-1bf3-455a-be0e-adf0dd4fcee2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-69a67d4d-7073-447e-94bb-d11d240c0db7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-e0c53c2d-5b88-4ead-a492-2121635bcc9c" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-e0c53c2d-5b88-4ead-a492-2121635bcc9c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Deleting offline snapshot e0c53c2d-5b88-4ead-a492-2121635bcc9c of volume 69a67d4d-7073-447e-94bb-d11d240c0db7 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] snapshot_file for this snap is: volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6edc2c-9373-4e3b-95ff-c5a013bb8ef6]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:39 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 Nov 01 09:35:39 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:39 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c Nov 01 09:35:39 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:39 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" returned: 0 in 0.430s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:39 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 Nov 01 09:35:39 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:39 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c" returned: 0 in 0.437s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69a67d4d-7073-447e-94bb-d11d240c0db7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9170e8-7d9f-4d74-843e-14e4e4d72435]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:40 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 Nov 01 09:35:40 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:40 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7" returned: 0 in 0.536s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:40 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c Nov 01 09:35:40 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:41 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c" returned: 0 in 0.677s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:41 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c Nov 01 09:35:41 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:41 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7.e0c53c2d-5b88-4ead-a492-2121635bcc9c" returned: 0 in 0.489s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-e0c53c2d-5b88-4ead-a492-2121635bcc9c" released by "_delete_snapshot" :: held 2.327s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-69a67d4d-7073-447e-94bb-d11d240c0db7" released by "delete_snapshot" :: held 2.362s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:41 devstack cinder-volume[86594]: WARNING cinder.quota [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1784495140 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1784495140, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:41 devstack cinder-volume[86594]: WARNING cinder.quota [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1784495140 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1784495140, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:41 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['0846b8cd-1c1a-4e82-b125-5fb80c6c3b19', '06f4ddf5-99c1-4454-bb67-cab74b77a21b', '3d6a56a4-ce77-4c13-ab22-36c39a5e7a39', '0e4d7403-57c2-4be5-aff3-dfb04dfffaa3'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:42 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['e037d313-f39c-45b1-be94-700ad58e648f', '5f6e3cf0-d702-4d7a-9b55-f77aae4b2ef7', '7fc7d720-f2de-48e4-b530-02ddeb133f71', 'aad733d1-1c02-468e-bd38-5b64fa51e805'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-37ce84ee-ff74-470a-92bb-cfd3654e97e5 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot db29bcb4-ebd0-4b9a-b1e9-73a841e94614: deleted successfully Nov 01 09:35:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-69a67d4d-7073-447e-94bb-d11d240c0db7" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-69a67d4d-7073-447e-94bb-d11d240c0db7" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:44 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[140485ac-ef55-4ea1-a487-7fac39af6958]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:44 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-47c22cef-c35c-4e7b-b93f-b50bc86ad96a req-98339a0e-2306-465e-8336-9cf611b6dea3 tempest-ServerActionsTestOtherA-1951790121 None] Terminate volume connection completed successfully. Nov 01 09:35:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-47c22cef-c35c-4e7b-b93f-b50bc86ad96a req-98339a0e-2306-465e-8336-9cf611b6dea3 tempest-ServerActionsTestOtherA-1951790121 None] Deleting attachment 49d7cf70-daff-403a-bf82-b3962855cfac. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:35:44 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 Nov 01 09:35:44 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:44 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7" returned: 0 in 0.698s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:44 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7 Nov 01 09:35:44 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:45 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-69a67d4d-7073-447e-94bb-d11d240c0db7" returned: 0 in 0.683s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-69a67d4d-7073-447e-94bb-d11d240c0db7" released by "delete_volume" :: held 1.541s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" acquired by "delete_volume" :: waited 0.074s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:45 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c62f596-c508-45e3-8576-da044a41c864]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:45 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 Nov 01 09:35:45 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:46 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" returned: 0 in 0.586s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:46 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5 Nov 01 09:35:46 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:46 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" returned: 0 in 0.600s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-7619d5ee-8185-4ee2-9e85-3c5180b8a3e5" released by "delete_volume" :: held 1.416s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['5253be18-88e0-4885-97f9-725f6ab0b304'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:47 devstack cinder-volume[86594]: WARNING cinder.quota [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1784495140 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1784495140, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['9a056361-4ec4-43c7-9719-cd918a51d427', '24aaaa09-735a-422e-a30b-cc49ad3d6b0d', 'f1e2e923-ad6f-4bc6-b7a5-e1c51bf240db', 'cf93c120-b441-4b06-a768-474b6c2467f1'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['56f81aef-ed09-4ccb-9b34-9b4d2451ac66', '1ea96a28-ba6d-4eee-90d6-f9359ad70996', '90e5d0a1-955c-4aa0-a4db-3285a89a53b7', '7fb5b470-8994-4e80-9151-eb49b87df76d'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:47 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:47 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:48 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.688s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:48 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:48 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ea220452-1c40-4516-a900-ed87758d88a9 tempest-GroupSnapshotsTest-1538292768 None] Delete group completed successfully. Nov 01 09:35:48 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9" returned: 0 in 9.019s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:48 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6, size 1024.00 MB, duration 9.02 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:35:48 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Converted 1024.00 MB image at 113.52 MB/s Nov 01 09:35:48 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:48 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 Nov 01 09:35:48 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-40955fab-14d4-4710-9b8c-c9d5e75b253d tempest-GroupSnapshotsTest-1538292768 None] Group tempest-GroupSnapshotsTest-Group-592377300: creating Nov 01 09:35:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-40955fab-14d4-4710-9b8c-c9d5e75b253d tempest-GroupSnapshotsTest-1538292768 None] Group tempest-GroupSnapshotsTest-Group-592377300: created successfully Nov 01 09:35:49 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-40955fab-14d4-4710-9b8c-c9d5e75b253d tempest-GroupSnapshotsTest-1538292768 None] Create group completed successfully. Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Lock "cinder-quobyte-c43b0f1e-b7be-4459-94de-676c41b3a3e9" released by "_copy_volume_from_snapshot" :: held 10.199s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Acquiring lock "cinder-quobyte-a2dfbb2b-1cfc-484c-a610-c239ac722da3" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Lock "cinder-quobyte-a2dfbb2b-1cfc-484c-a610-c239ac722da3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Deleting offline snapshot a2dfbb2b-1cfc-484c-a610-c239ac722da3 of volume b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] snapshot_file for this snap is: volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf154537-037f-42b9-828c-2330f0503142]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:49 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 Nov 01 09:35:49 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:49 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3" returned: 0 in 0.371s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c617611-252c-4763-82ac-a52d18c3eb99]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:49 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 Nov 01 09:35:49 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:50 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" returned: 0 in 0.581s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:50 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 Nov 01 09:35:50 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:50 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3" returned: 0 in 0.392s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:50 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3 Nov 01 09:35:50 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Flow 'volume_create_manager' (c532f90d-4b64-4822-851e-79145e325ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3453d72-d77c-455b-bcfe-ccdf75bf9a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3453d72-d77c-455b-bcfe-ccdf75bf9a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-17212129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8eb92c20-0c32-436d-af99-c6cbfd9a81db,host='devstack@QuobyteHD#QuobyteHD',id=2aed10b0-8090-4261-8663-b7192ca9b970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a1ed50324490980affe979404fb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:51Z,use_quota=True,user_id='ffb7d4fb59334ed39126a53e9341c7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d77d3824-57be-46ef-83f6-fe60b8535652),volume_type_id=d77d3824-57be-46ef-83f6-fe60b8535652)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c237f1a7-81f8-4dbb-9cf5-a27cf1433f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c237f1a7-81f8-4dbb-9cf5-a27cf1433f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b200d3-de8d-4adf-a6ce-7135dfb5e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b200d3-de8d-4adf-a6ce-7135dfb5e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aed10b0-8090-4261-8663-b7192ca9b970', 'volume_name': 'volume-2aed10b0-8090-4261-8663-b7192ca9b970', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28362d33-377d-4446-8d28-7b47fd491135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28362d33-377d-4446-8d28-7b47fd491135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:50 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1614978e-7dc6-415d-9b71-204ab794b459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:50 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Volume 2aed10b0-8090-4261-8663-b7192ca9b970: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aed10b0-8090-4261-8663-b7192ca9b970', 'volume_size': 1} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6.a2dfbb2b-1cfc-484c-a610-c239ac722da3" returned: 0 in 0.308s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Lock "cinder-quobyte-a2dfbb2b-1cfc-484c-a610-c239ac722da3" released by "_delete_snapshot" :: held 1.752s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.386s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.865s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1649854259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f034b1c7-d838-4f43-8c70-3ac45ee1cf1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687e7c01e55a428c954f7845bc64ceec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:38Z,use_quota=True,user_id='bab7b6a5a3a54d0a83937d2af694d7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Creating volume f034b1c7-d838-4f43-8c70-3ac45ee1cf1d {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:50 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:35:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:50 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d 1073741824 Nov 01 09:35:50 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-961b2bb8-f1c2-4964-a69e-9c535fd95bf1 tempest-GroupsV314Test-286269182 None] Create group from source-group-65a70cac-98fb-490a-8347-d6607270efc0 completed successfully. Nov 01 09:35:51 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d 1073741824" returned: 0 in 0.441s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:51 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d Nov 01 09:35:51 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:51 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d" returned: 0 in 0.258s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.803s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8eb92c20-0c32-436d-af99-c6cbfd9a81db,created_at=2026-11-01T08:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-17212129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8eb92c20-0c32-436d-af99-c6cbfd9a81db,host='devstack@QuobyteHD#QuobyteHD',id=2aed10b0-8090-4261-8663-b7192ca9b970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a39a1ed50324490980affe979404fb2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:51Z,use_quota=True,user_id='ffb7d4fb59334ed39126a53e9341c7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d77d3824-57be-46ef-83f6-fe60b8535652),volume_type_id=d77d3824-57be-46ef-83f6-fe60b8535652)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Creating volume 2aed10b0-8090-4261-8663-b7192ca9b970 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:51 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:51 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 1073741824 Nov 01 09:35:51 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70d4e721-08bc-4ad7-be51-08cb321668b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b9c409-56f7-4f1f-8347-8c1459cdab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Flow 'volume_create_manager' (d172b3da-459a-4e2f-9628-53dd0d19c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbf2113-7e8b-4e24-a8a2-de1fe44a0b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:51 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Volume volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d (f034b1c7-d838-4f43-8c70-3ac45ee1cf1d): created successfully Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b9c409-56f7-4f1f-8347-8c1459cdab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Flow 'volume_create_manager' (9e99dcea-f0f1-4ffb-9bdb-d7c697bae1c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfbf2113-7e8b-4e24-a8a2-de1fe44a0b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1374187885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195340a2-c420-4693-9f6a-8aa36202a3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146ff96417654df9b0f92f37c3f77a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:52Z,use_quota=True,user_id='40dd6fbacb2b46ad9b3fef9e3e8a27c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a250f33-1b5f-41e8-9e38-c17dbbade1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a250f33-1b5f-41e8-9e38-c17dbbade1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52eea319-a3ad-47fa-9a62-26dd31444971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:51 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:35:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-dfd77915-740d-4280-97df-feea9def0d1d tempest-TaggedAttachmentsTest-796816599 None] Created volume successfully. Nov 01 09:35:52 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 1073741824" returned: 0 in 0.444s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:52 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 Nov 01 09:35:52 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52eea319-a3ad-47fa-9a62-26dd31444971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '195340a2-c420-4693-9f6a-8aa36202a3b7', 'volume_name': 'volume-195340a2-c420-4693-9f6a-8aa36202a3b7', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ce75af-fac4-4c1e-9a53-350d52eaf258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ce75af-fac4-4c1e-9a53-350d52eaf258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861371f7-f3ee-47c1-b1c3-609e1cdcda1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:52 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Volume 195340a2-c420-4693-9f6a-8aa36202a3b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-195340a2-c420-4693-9f6a-8aa36202a3b7', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Trying to clone 195340a2-c420-4693-9f6a-8aa36202a3b7 from image c507ec59-c87f-4d5c-be6c-eab60d7c916d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:35:52 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970" returned: 0 in 0.281s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1614978e-7dc6-415d-9b71-204ab794b459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aed10b0-8090-4261-8663-b7192ca9b970', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f297162a-124c-4ce8-80a7-660f95eabfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:35:52 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Volume volume-2aed10b0-8090-4261-8663-b7192ca9b970 (2aed10b0-8090-4261-8663-b7192ca9b970): created successfully Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f297162a-124c-4ce8-80a7-660f95eabfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Flow 'volume_create_manager' (c532f90d-4b64-4822-851e-79145e325ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:35:52 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-94656303-b7ba-4dda-a9ca-0ad3b221581b tempest-GroupSnapshotsTest-1538292768 None] Created volume successfully. Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:35:52 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Image download 20.69 MB at 20.69 MB/s Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Acquiring lock "cinder-quobyte-c43b0f1e-b7be-4459-94de-676c41b3a3e9" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Lock "cinder-quobyte-c43b0f1e-b7be-4459-94de-676c41b3a3e9" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f5efc1-82de-4ead-a01b-ddab6becb39b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac721316-8694-47e1-b3f6-7d17c81728ac]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:52 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD Nov 01 09:35:52 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:52 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 Nov 01 09:35:52 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:53 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d is fetched for user 40dd6fbacb2b46ad9b3fef9e3e8a27c4. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:35:53 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9" returned: 0 in 0.436s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9337d5-39d4-4b1f-ad7d-cec21766edbb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:53 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9 Nov 01 09:35:53 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:53 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD Nov 01 09:35:53 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:53 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:53 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:53 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c43b0f1e-b7be-4459-94de-676c41b3a3e9" returned: 0 in 0.303s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Lock "cinder-quobyte-c43b0f1e-b7be-4459-94de-676c41b3a3e9" released by "delete_volume" :: held 0.811s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:53 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] GroupSnapshot 9f08a4e0-1147-40d4-9398-907ea0de8482: creating. Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Group snapshot 9f08a4e0-1147-40d4-9398-907ea0de8482: creating. {{(pid=86594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Creating offline snapshot 823434fa-5244-4168-b543-575dfd9fe898 of volume 2aed10b0-8090-4261-8663-b7192ca9b970 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:35:53 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Created reservations ['b607a5a5-a5b6-4ac4-94ac-1ff7c384560b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d8ed5e-7c1b-4212-ba0f-2f0acc567cf4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:53 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.339s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:35:53 devstack cinder-volume[86594]: WARNING cinder.quota [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-316999291 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-316999291, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:53 devstack cinder-volume[86594]: WARNING cinder.quota [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-316999291 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-316999291, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Created reservations ['74a23fbf-9edb-4290-a711-1ea2f251357f', '65008102-03de-4a89-b5d1-bfeeab7a5d3c', 'c73c4379-f5c6-4de7-8763-9b9c2e8c8a22', 'a57390c9-d970-48b1-a64b-43de20b9a7cc'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:53 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 Nov 01 09:35:53 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:53 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:53 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:54 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970" returned: 0 in 0.442s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:54 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 1G Nov 01 09:35:54 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:54 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:54 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:54 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5e874522-936f-45be-97bd-7d7acb9f21da tempest-GroupsV314Test-286269182 None] Delete group completed successfully. Nov 01 09:35:54 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 1G" returned: 0 in 0.430s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aed10b0-8090-4261-8663-b7192ca9b970 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:54 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aed10b0-8090-4261-8663-b7192ca9b970 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 Nov 01 09:35:54 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:54 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aed10b0-8090-4261-8663-b7192ca9b970 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898" returned: 0 in 0.304s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:54 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:54 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 Nov 01 09:35:54 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:55 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:55 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.info Nov 01 09:35:55 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Acquiring lock "cinder-quobyte-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Lock "cinder-quobyte-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e7a2e6-9d98-4cbc-8825-a798bc296f8a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:55 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 Nov 01 09:35:55 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:55 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.info" returned: 0 in 0.293s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:55 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:55 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.info Nov 01 09:35:55 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:55 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" returned: 0 in 0.412s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:55 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.info" returned: 0 in 0.257s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:55 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6 Nov 01 09:35:55 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.073s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1374187885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195340a2-c420-4693-9f6a-8aa36202a3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='146ff96417654df9b0f92f37c3f77a32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:35:52Z,use_quota=True,user_id='40dd6fbacb2b46ad9b3fef9e3e8a27c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Creating volume 195340a2-c420-4693-9f6a-8aa36202a3b7 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:35:55 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:55 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 1073741824 Nov 01 09:35:55 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1dd56829-40a2-4a73-aed8-be1ecab6f342 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot 9f08a4e0-1147-40d4-9398-907ea0de8482: created successfully Nov 01 09:35:55 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" returned: 0 in 0.310s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Lock "cinder-quobyte-b9a41f26-9a84-41d2-81d3-23a59f41f3d6" released by "delete_volume" :: held 0.812s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:55 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Created reservations ['dd6a6707-9764-4bd1-b8f9-8a806ba78e43'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Created reservations ['5e3ffab4-8dac-466a-92bc-99b25d80b313', 'a7f2fdd8-ab62-48ad-90b6-dadd1a9f651d', '92bc52c7-071e-45d2-8211-c0014ef52bc3', 'e09ca4b4-0cbd-4d17-ada9-74d7642746fa'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:56 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 1073741824" returned: 0 in 0.544s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:56 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:35:56 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:56 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 Nov 01 09:35:56 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:56 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:35:56 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1bb72989-dba7-4017-ba34-e6ad124a3fa1 tempest-GroupsV314Test-286269182 None] Delete group completed successfully. Nov 01 09:35:56 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7" returned: 0 in 0.319s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Attempting download of c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 195340a2-c420-4693-9f6a-8aa36202a3b7. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70333e3-f927-4fac-bbc1-bc0d49b34f8e]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_0myn3c28 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:56 devstack sudo[90486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_0myn3c28 Nov 01 09:35:56 devstack sudo[90486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:56 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot 9f08a4e0-1147-40d4-9398-907ea0de8482: deleting Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot 9f08a4e0-1147-40d4-9398-907ea0de8482: deleting {{(pid=86594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-2aed10b0-8090-4261-8663-b7192ca9b970" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-2aed10b0-8090-4261-8663-b7192ca9b970" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-823434fa-5244-4168-b543-575dfd9fe898" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-823434fa-5244-4168-b543-575dfd9fe898" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Deleting offline snapshot 823434fa-5244-4168-b543-575dfd9fe898 of volume 2aed10b0-8090-4261-8663-b7192ca9b970 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] snapshot_file for this snap is: volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e9ac7-8882-4e43-85ea-593f0e22ec06]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:57 devstack sudo[90486]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_0myn3c28" returned: 0 in 0.470s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_0myn3c28 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:57 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_0myn3c28 Nov 01 09:35:57 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 Nov 01 09:35:57 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:57 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:57 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_0myn3c28" returned: 1 in 0.435s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_0myn3c28' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f113ea-e932-47f5-93e2-bb02e2ea8f87]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:57 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898" returned: 0 in 0.543s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aed10b0-8090-4261-8663-b7192ca9b970(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f3b5b-0cdb-44e6-a1ed-3ba1aa959b2c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:35:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:57 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD Nov 01 09:35:57 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:57 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 Nov 01 09:35:57 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:58 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:58 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] c507ec59-c87f-4d5c-be6c-eab60d7c916d was qcow2, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:35:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:58 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 Nov 01 09:35:58 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:58 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970" returned: 0 in 0.510s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:58 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 Nov 01 09:35:58 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:58 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898" returned: 0 in 0.559s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:35:58 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898 Nov 01 09:35:58 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:35:59 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Nov 01 09:35:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970.823434fa-5244-4168-b543-575dfd9fe898" returned: 0 in 0.343s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:35:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-823434fa-5244-4168-b543-575dfd9fe898" released by "_delete_snapshot" :: held 2.123s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-2aed10b0-8090-4261-8663-b7192ca9b970" released by "delete_snapshot" :: held 2.165s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:35:59 devstack cinder-volume[86594]: WARNING cinder.quota [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-155500923 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-155500923, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:59 devstack cinder-volume[86594]: WARNING cinder.quota [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-155500923 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-155500923, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:35:59 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['f3def3c5-0f64-4270-a245-b156b842cfa0', '5de95990-8abc-4e72-afa3-753b5c1a0a3c', '1d704df5-89bc-4197-9c12-0835d39e6f0b', 'f1e849b5-68fc-44ae-8fe8-e54bc0ece6ae'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:35:59 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ca39961f-7ecf-4e11-a560-25c21914fb51 tempest-GroupSnapshotsTest-1538292768 None] group_snapshot 9f08a4e0-1147-40d4-9398-907ea0de8482: deleted successfully Nov 01 09:36:00 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7" returned: 0 in 2.585s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:00 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_esdz7an7devstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:36:00 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Converted 112.00 MB image at 43.31 MB/s Nov 01 09:36:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:00 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 1G Nov 01 09:36:00 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "cinder-quobyte-2aed10b0-8090-4261-8663-b7192ca9b970" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-2aed10b0-8090-4261-8663-b7192ca9b970" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585a906-e548-4db5-8a81-5c922ac15929]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:01 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 Nov 01 09:36:01 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:01 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 1G" returned: 0 in 0.547s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Downloaded image c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 195340a2-c420-4693-9f6a-8aa36202a3b7 successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d for user 40dd6fbacb2b46ad9b3fef9e3e8a27c4 is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Marking volume 195340a2-c420-4693-9f6a-8aa36202a3b7 as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Copying metadata from image c507ec59-c87f-4d5c-be6c-eab60d7c916d to 195340a2-c420-4693-9f6a-8aa36202a3b7. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Creating volume glance metadata for volume 195340a2-c420-4693-9f6a-8aa36202a3b7 backed by image c507ec59-c87f-4d5c-be6c-eab60d7c916d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (861371f7-f3ee-47c1-b1c3-609e1cdcda1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-195340a2-c420-4693-9f6a-8aa36202a3b7', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a310c972-0fbb-483b-b27b-e43a8d811c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:01 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Volume volume-195340a2-c420-4693-9f6a-8aa36202a3b7 (195340a2-c420-4693-9f6a-8aa36202a3b7): created successfully Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a310c972-0fbb-483b-b27b-e43a8d811c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Flow 'volume_create_manager' (d172b3da-459a-4e2f-9628-53dd0d19c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:01 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-001a549e-524a-4994-a032-f3cc0c7ed869 tempest-ServerActionsTestOtherA-1951790121 None] Created volume successfully. Nov 01 09:36:01 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970" returned: 0 in 0.804s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:01 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970 Nov 01 09:36:01 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:02 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2aed10b0-8090-4261-8663-b7192ca9b970" returned: 0 in 0.537s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Lock "cinder-quobyte-2aed10b0-8090-4261-8663-b7192ca9b970" released by "delete_volume" :: held 1.476s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['ed975f98-be1e-4573-967e-9b20e0897167'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:02 devstack cinder-volume[86594]: WARNING cinder.quota [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-155500923 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-155500923, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Created reservations ['b55cdf85-4a0c-4aed-920f-af7c2d0173b6', '6436c896-e8f0-440b-87c3-cc9c03900ce3', 'cac3e2d7-55ad-4eee-a9f8-80d428c3f44b', '321e986c-52be-4f14-94b8-f64702c48bc7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:02 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:36:02 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:03 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.315s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:03 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:36:03 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-59bcd379-4a2a-48e3-b74b-f94ebf1bbdbd tempest-GroupSnapshotsTest-1538292768 None] Delete group completed successfully. Nov 01 09:36:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-54c89b15-6a6d-4ca5-a67d-e2069c80a3cb tempest-GroupsV320Test-515724679 None] Group tempest-GroupsV320Test-Group-1605681614: creating Nov 01 09:36:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-54c89b15-6a6d-4ca5-a67d-e2069c80a3cb tempest-GroupsV320Test-515724679 None] Group tempest-GroupsV320Test-Group-1605681614: created successfully Nov 01 09:36:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-54c89b15-6a6d-4ca5-a67d-e2069c80a3cb tempest-GroupsV320Test-515724679 None] Create group completed successfully. Nov 01 09:36:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-604557c7-9884-448a-88f9-bdbc9c0d3c40 req-0e399ea0-634a-4cc3-8263-ddce3b8299ed tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-604557c7-9884-448a-88f9-bdbc9c0d3c40 req-0e399ea0-634a-4cc3-8263-ddce3b8299ed tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-604557c7-9884-448a-88f9-bdbc9c0d3c40 req-0e399ea0-634a-4cc3-8263-ddce3b8299ed tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-604557c7-9884-448a-88f9-bdbc9c0d3c40 req-0e399ea0-634a-4cc3-8263-ddce3b8299ed tempest-ServerActionsTestOtherA-1951790121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-195340a2-c420-4693-9f6a-8aa36202a3b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3af49d30-52bc-4042-acf3-f293bc08573b', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:36:07 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-604557c7-9884-448a-88f9-bdbc9c0d3c40 req-0e399ea0-634a-4cc3-8263-ddce3b8299ed tempest-ServerActionsTestOtherA-1951790121 None] attachment_update completed successfully. Nov 01 09:36:08 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Created reservations ['76b2d0c1-d23a-46b8-8379-fa389bc9c3b4'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:08 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:36:08 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:09 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:09 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:36:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f091149c-ad23-4c01-8bb8-9cf6efa901dd tempest-GroupsV320Test-515724679 None] Delete group completed successfully. Nov 01 09:36:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a8b47c7f-c164-4d67-8ee4-7a9daba80fff tempest-GroupSnapshotsV319Test-326879294 None] Group tempest-GroupSnapshotsV319Test-Group-1901940792: creating Nov 01 09:36:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a8b47c7f-c164-4d67-8ee4-7a9daba80fff tempest-GroupSnapshotsV319Test-326879294 None] Group tempest-GroupSnapshotsV319Test-Group-1901940792: created successfully Nov 01 09:36:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a8b47c7f-c164-4d67-8ee4-7a9daba80fff tempest-GroupSnapshotsV319Test-326879294 None] Create group completed successfully. Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Flow 'volume_create_manager' (6e26de84-9e4b-4a97-bdd7-1db17a0e1f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839636a2-7853-4b67-89ff-5cd4bdf39352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839636a2-7853-4b67-89ff-5cd4bdf39352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1177306522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d0975b4-722f-4b9d-9d8a-44b790ee6b14,host='devstack@QuobyteHD#QuobyteHD',id=749efacd-a7b2-42be-b7b9-9013a7aa73c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fba442258a4dcf917bca83a2507086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:36:19Z,use_quota=True,user_id='2ab5abca5d2e4f0da94e0ac49bad65de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0869b0ba-5686-400d-bf97-14f5c4074bce),volume_type_id=0869b0ba-5686-400d-bf97-14f5c4074bce)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd5b657-be93-4098-b73b-6e3ca2330082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd5b657-be93-4098-b73b-6e3ca2330082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dd27d2-6333-4eef-b38a-8f64c87c9e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73dd27d2-6333-4eef-b38a-8f64c87c9e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '749efacd-a7b2-42be-b7b9-9013a7aa73c3', 'volume_name': 'volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9138cfdd-aa01-4a0f-a913-363e00f3a33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9138cfdd-aa01-4a0f-a913-363e00f3a33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d835e6ec-097f-4645-ba8f-0fb15421c3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:19 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Volume 749efacd-a7b2-42be-b7b9-9013a7aa73c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3', 'volume_size': 1} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d0975b4-722f-4b9d-9d8a-44b790ee6b14,created_at=2026-11-01T08:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1177306522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d0975b4-722f-4b9d-9d8a-44b790ee6b14,host='devstack@QuobyteHD#QuobyteHD',id=749efacd-a7b2-42be-b7b9-9013a7aa73c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fba442258a4dcf917bca83a2507086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:36:19Z,use_quota=True,user_id='2ab5abca5d2e4f0da94e0ac49bad65de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0869b0ba-5686-400d-bf97-14f5c4074bce),volume_type_id=0869b0ba-5686-400d-bf97-14f5c4074bce)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Creating volume 749efacd-a7b2-42be-b7b9-9013a7aa73c3 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:36:19 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:36:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:19 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 1073741824 Nov 01 09:36:19 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:20 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 1073741824" returned: 0 in 0.666s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:20 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 Nov 01 09:36:20 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:20 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3" returned: 0 in 0.360s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d835e6ec-097f-4645-ba8f-0fb15421c3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0396fece-3212-4d8b-b2f6-f59b2ac2a493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:20 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Volume volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 (749efacd-a7b2-42be-b7b9-9013a7aa73c3): created successfully Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0396fece-3212-4d8b-b2f6-f59b2ac2a493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Flow 'volume_create_manager' (6e26de84-9e4b-4a97-bdd7-1db17a0e1f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-78bbb1e0-f5ea-4c58-b801-9914f75db86a tempest-GroupSnapshotsV319Test-326879294 None] Created volume successfully. Nov 01 09:36:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] GroupSnapshot aee0d10a-53c8-4b2b-a426-bf835421c81f: creating. Nov 01 09:36:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Group snapshot aee0d10a-53c8-4b2b-a426-bf835421c81f: creating. {{(pid=86594) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 09:36:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Creating offline snapshot 76e37aba-3ea9-45a6-9082-d7de6449f040 of volume 749efacd-a7b2-42be-b7b9-9013a7aa73c3 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:36:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0ee709-3a3b-49c2-a22c-101dcb7de218]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:22 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 Nov 01 09:36:22 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:22 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3" returned: 0 in 0.526s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:22 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 1G Nov 01 09:36:22 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:23 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 1G" returned: 0 in 0.675s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:23 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 Nov 01 09:36:23 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:24 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040" returned: 0 in 0.640s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:24 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:36:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:24 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 Nov 01 09:36:24 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:24 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040" returned: 0 in 0.374s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:24 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.info Nov 01 09:36:24 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:24 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.info" returned: 0 in 0.445s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:24 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 09:36:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:25 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.info Nov 01 09:36:25 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:25 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.info" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.133s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a7edd340-93c5-4005-b752-7eb0eaa85d89 tempest-GroupSnapshotsV319Test-326879294 None] group_snapshot aee0d10a-53c8-4b2b-a426-bf835421c81f: created successfully Nov 01 09:36:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-7bfaf5e7-59f4-4e53-9b73-43827588d3e5 req-75effc99-d910-49e0-9b0d-e19d6d4d937d tempest-ServerActionsTestOtherA-1951790121 None] Terminate volume connection completed successfully. Nov 01 09:36:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-7bfaf5e7-59f4-4e53-9b73-43827588d3e5 req-75effc99-d910-49e0-9b0d-e19d6d4d937d tempest-ServerActionsTestOtherA-1951790121 None] Deleting attachment 3af49d30-52bc-4042-acf3-f293bc08573b. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:36:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] group_snapshot aee0d10a-53c8-4b2b-a426-bf835421c81f: deleting Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] group_snapshot aee0d10a-53c8-4b2b-a426-bf835421c81f: deleting {{(pid=86594) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Acquiring lock "cinder-quobyte-749efacd-a7b2-42be-b7b9-9013a7aa73c3" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Lock "cinder-quobyte-749efacd-a7b2-42be-b7b9-9013a7aa73c3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Acquiring lock "cinder-quobyte-76e37aba-3ea9-45a6-9082-d7de6449f040" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Lock "cinder-quobyte-76e37aba-3ea9-45a6-9082-d7de6449f040" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Deleting offline snapshot 76e37aba-3ea9-45a6-9082-d7de6449f040 of volume 749efacd-a7b2-42be-b7b9-9013a7aa73c3 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] snapshot_file for this snap is: volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d0ce49-e596-40a1-a493-0ce8f42067c5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:28 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 Nov 01 09:36:28 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-7bfaf5e7-59f4-4e53-9b73-43827588d3e5 req-06ca1dd8-4904-4173-bbb7-df2bad8a1df2 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-7bfaf5e7-59f4-4e53-9b73-43827588d3e5 req-06ca1dd8-4904-4173-bbb7-df2bad8a1df2 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-7bfaf5e7-59f4-4e53-9b73-43827588d3e5 req-06ca1dd8-4904-4173-bbb7-df2bad8a1df2 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-7bfaf5e7-59f4-4e53-9b73-43827588d3e5 req-06ca1dd8-4904-4173-bbb7-df2bad8a1df2 tempest-ServerActionsTestOtherA-1951790121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-195340a2-c420-4693-9f6a-8aa36202a3b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59c64295-bf5a-41e0-9c06-e4b4f8b7f291', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:36:28 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040" returned: 0 in 0.573s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:36:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5628ce-0bf7-41c7-906a-e86fdc302e0e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-7bfaf5e7-59f4-4e53-9b73-43827588d3e5 req-06ca1dd8-4904-4173-bbb7-df2bad8a1df2 tempest-ServerActionsTestOtherA-1951790121 None] attachment_update completed successfully. Nov 01 09:36:28 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 Nov 01 09:36:28 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:29 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3" returned: 0 in 0.646s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:29 devstack sudo[91283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 Nov 01 09:36:29 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:29 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040" returned: 0 in 0.678s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:29 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040 Nov 01 09:36:29 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:30 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3.76e37aba-3ea9-45a6-9082-d7de6449f040" returned: 0 in 0.442s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Lock "cinder-quobyte-76e37aba-3ea9-45a6-9082-d7de6449f040" released by "_delete_snapshot" :: held 2.505s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Lock "cinder-quobyte-749efacd-a7b2-42be-b7b9-9013a7aa73c3" released by "delete_snapshot" :: held 2.555s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:30 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=129,cinder:UPDATE=112,cinder:INSERT=25,cinder:DELETE=2 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:36:30 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=127,cinder:INSERT=36,cinder:UPDATE=100,cinder:DELETE=3 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:36:30 devstack cinder-volume[86594]: WARNING cinder.quota [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1111487478 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1111487478, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:36:30 devstack cinder-volume[86594]: WARNING cinder.quota [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1111487478 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1111487478, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:36:30 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] Created reservations ['3f4a8465-cc83-4bd0-81ea-90e3163cb89b', '902f993e-808a-4699-81d8-42e5e0cc536c', 'ecc108e8-7491-418d-abbb-45150c9c4eab', '92849875-4002-4a9a-8b50-f53a0b97c8f1'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1aa5f330-b636-411e-9a01-e8597bbe281c tempest-GroupSnapshotsV319Test-326879294 None] group_snapshot aee0d10a-53c8-4b2b-a426-bf835421c81f: deleted successfully Nov 01 09:36:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Acquiring lock "cinder-quobyte-749efacd-a7b2-42be-b7b9-9013a7aa73c3" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Lock "cinder-quobyte-749efacd-a7b2-42be-b7b9-9013a7aa73c3" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:31 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6311dd2-d4da-454c-bb8f-f4c1c6122269]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:31 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 Nov 01 09:36:31 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:31 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:36:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Flow 'volume_create_manager' (7e853ac7-b68a-412c-911a-30fa8ca74784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e2fa6d-d317-46e6-9fa1-f81bb7eee7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e2fa6d-d317-46e6-9fa1-f81bb7eee7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2078891199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c464df-8006-4204-864b-27efaed8692b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab34c0521d474e76995a2908beb2f1d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:36:32Z,use_quota=True,user_id='4d8d5f158a84496b87ace0fd4e39d651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36037b3a-97cc-489e-ae18-33d8e7c8fd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36037b3a-97cc-489e-ae18-33d8e7c8fd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c17073-5e10-4881-b82c-b0328bce8012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c17073-5e10-4881-b82c-b0328bce8012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c464df-8006-4204-864b-27efaed8692b', 'volume_name': 'volume-38c464df-8006-4204-864b-27efaed8692b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13887161-45ac-470b-b9fd-b53dc4873f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13887161-45ac-470b-b9fd-b53dc4873f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90beb30e-6bfb-4ba8-aef2-c213259bb41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:32 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Volume 38c464df-8006-4204-864b-27efaed8692b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c464df-8006-4204-864b-27efaed8692b', 'volume_size': 1} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2078891199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c464df-8006-4204-864b-27efaed8692b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab34c0521d474e76995a2908beb2f1d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:36:32Z,use_quota=True,user_id='4d8d5f158a84496b87ace0fd4e39d651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Creating volume 38c464df-8006-4204-864b-27efaed8692b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:36:32 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:32 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b 1073741824 Nov 01 09:36:32 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:32 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3" returned: 0 in 0.704s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:32 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3 Nov 01 09:36:32 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:33 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-749efacd-a7b2-42be-b7b9-9013a7aa73c3" returned: 0 in 0.863s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Lock "cinder-quobyte-749efacd-a7b2-42be-b7b9-9013a7aa73c3" released by "delete_volume" :: held 1.745s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:33 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b 1073741824" returned: 0 in 1.299s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Created reservations ['c2cf5a25-8ee4-41c2-97c0-5699f9a1db18'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:33 devstack cinder-volume[86594]: WARNING cinder.quota [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1111487478 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1111487478, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:36:33 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b Nov 01 09:36:33 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Created reservations ['fa12623e-4699-4800-9ff5-0c4b91c51e01', '494a77dc-c695-4e5c-9b2c-832e3fac906c', 'bfa95e1c-ea87-4f29-b760-ba1eb86a249a', 'b7d2c082-7d53-4ba1-9f57-8e59f9ec80e0'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:34 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:36:34 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:34 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b" returned: 0 in 0.627s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90beb30e-6bfb-4ba8-aef2-c213259bb41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c464df-8006-4204-864b-27efaed8692b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20831926-49d1-47b6-ad08-9f276ecdb07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:34 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Volume volume-38c464df-8006-4204-864b-27efaed8692b (38c464df-8006-4204-864b-27efaed8692b): created successfully Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20831926-49d1-47b6-ad08-9f276ecdb07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Flow 'volume_create_manager' (7e853ac7-b68a-412c-911a-30fa8ca74784) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:34 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-685ae8a8-e131-4f4a-b883-c3ad3757c7a6 tempest-VolumeQuotasAdminTestJSON-652238105 None] Created volume successfully. Nov 01 09:36:34 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.711s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:34 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:36:34 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6fd43fcd-f3df-4c7d-9354-2309f5f1c4e3 tempest-GroupSnapshotsV319Test-326879294 None] Delete group completed successfully. Nov 01 09:36:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Acquiring lock "cinder-38c464df-8006-4204-864b-27efaed8692b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "cinder-38c464df-8006-4204-864b-27efaed8692b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Acquiring lock "cinder-quobyte-38c464df-8006-4204-864b-27efaed8692b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "cinder-quobyte-38c464df-8006-4204-864b-27efaed8692b" acquired by "delete_volume" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[930ea8c4-46e0-4594-818a-6ff4c2469d1c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:35 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b Nov 01 09:36:35 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-594830f4-02e6-47ca-937e-55dddaa54d6a req-f8524b1b-bbbb-4373-824d-3b5499367d27 tempest-TaggedAttachmentsTest-796816599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-594830f4-02e6-47ca-937e-55dddaa54d6a req-f8524b1b-bbbb-4373-824d-3b5499367d27 tempest-TaggedAttachmentsTest-796816599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-594830f4-02e6-47ca-937e-55dddaa54d6a req-f8524b1b-bbbb-4373-824d-3b5499367d27 tempest-TaggedAttachmentsTest-796816599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:36 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-594830f4-02e6-47ca-937e-55dddaa54d6a req-f8524b1b-bbbb-4373-824d-3b5499367d27 tempest-TaggedAttachmentsTest-796816599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0916e689-d3ab-4b34-9c25-ec6f2d0b4389', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:36:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-594830f4-02e6-47ca-937e-55dddaa54d6a req-f8524b1b-bbbb-4373-824d-3b5499367d27 tempest-TaggedAttachmentsTest-796816599 None] attachment_update completed successfully. Nov 01 09:36:36 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b" returned: 0 in 0.690s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:36 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b Nov 01 09:36:36 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:36 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-38c464df-8006-4204-864b-27efaed8692b" returned: 0 in 0.458s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "cinder-quobyte-38c464df-8006-4204-864b-27efaed8692b" released by "delete_volume" :: held 1.226s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Created reservations ['ef2e217b-74c8-4dae-bfa2-29cd97731b88', 'f69c4d7d-71b4-4f4d-936b-aee8e13f70cf', '73fecaba-aa88-45aa-b253-437d9f14dfa6', 'd001982c-8978-49a2-9e41-a20a00495ed6'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:37 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:36:37 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:37 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.445s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:36:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Deleted volume successfully. Nov 01 09:36:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-12363800-8890-4224-9058-564f748f40e7 tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "cinder-38c464df-8006-4204-864b-27efaed8692b-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Flow 'volume_create_manager' (f8737108-6417-4d46-a462-c390e0e12692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e000ea-83a0-416c-b10a-50e8197e282f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e000ea-83a0-416c-b10a-50e8197e282f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1537090283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415906f1-8cfb-431e-b769-56717eef6425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab34c0521d474e76995a2908beb2f1d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:36:39Z,use_quota=True,user_id='4d8d5f158a84496b87ace0fd4e39d651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3499e19d-b169-41bd-81cf-19fba5df8c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3499e19d-b169-41bd-81cf-19fba5df8c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990157d8-f1b5-4d5c-8ec8-e74a42f7d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990157d8-f1b5-4d5c-8ec8-e74a42f7d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '415906f1-8cfb-431e-b769-56717eef6425', 'volume_name': 'volume-415906f1-8cfb-431e-b769-56717eef6425', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3f950d-12d1-468a-9451-d9a2fdeb42d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3f950d-12d1-468a-9451-d9a2fdeb42d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4310bf-8f6f-4024-a43a-17d2016dc74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:39 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Volume 415906f1-8cfb-431e-b769-56717eef6425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-415906f1-8cfb-431e-b769-56717eef6425', 'volume_size': 1} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1537090283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=415906f1-8cfb-431e-b769-56717eef6425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab34c0521d474e76995a2908beb2f1d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:36:39Z,use_quota=True,user_id='4d8d5f158a84496b87ace0fd4e39d651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Creating volume 415906f1-8cfb-431e-b769-56717eef6425 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:36:39 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:39 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 1073741824 Nov 01 09:36:39 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:39 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 1073741824" returned: 0 in 0.674s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-0a52d49e-7557-4c46-a516-9c9f365022f6 req-14d85209-ab2e-4e39-8825-e4e58fe98c44 tempest-TaggedAttachmentsTest-796816599 None] Terminate volume connection completed successfully. Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-0a52d49e-7557-4c46-a516-9c9f365022f6 req-14d85209-ab2e-4e39-8825-e4e58fe98c44 tempest-TaggedAttachmentsTest-796816599 None] Deleting attachment 0916e689-d3ab-4b34-9c25-ec6f2d0b4389. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:36:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:40 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 Nov 01 09:36:40 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:40 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425" returned: 0 in 0.297s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:36:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec4310bf-8f6f-4024-a43a-17d2016dc74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-415906f1-8cfb-431e-b769-56717eef6425', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72df3eb2-c0e3-40ac-b44c-a0a9cc218ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:40 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Volume volume-415906f1-8cfb-431e-b769-56717eef6425 (415906f1-8cfb-431e-b769-56717eef6425): created successfully Nov 01 09:36:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72df3eb2-c0e3-40ac-b44c-a0a9cc218ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Flow 'volume_create_manager' (f8737108-6417-4d46-a462-c390e0e12692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:40 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d91310bf-270c-40ed-a97a-e88f288a960e tempest-VolumeQuotasAdminTestJSON-652238105 None] Created volume successfully. Nov 01 09:36:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c55842bd-718d-4c79-b4ae-56890636a14b tempest-VolumeQuotasAdminTestJSON-272746019 None] Transfer volume completed successfully. Nov 01 09:36:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Acquiring lock "cinder-415906f1-8cfb-431e-b769-56717eef6425-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Lock "cinder-415906f1-8cfb-431e-b769-56717eef6425-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Acquiring lock "cinder-quobyte-415906f1-8cfb-431e-b769-56717eef6425" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Lock "cinder-quobyte-415906f1-8cfb-431e-b769-56717eef6425" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f1769d-9cf1-4b68-a503-5a8fc297b805]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:43 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 Nov 01 09:36:43 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:44 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425" returned: 0 in 0.419s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:44 devstack sudo[91935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425 Nov 01 09:36:44 devstack sudo[91935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:44 devstack sudo[91935]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-415906f1-8cfb-431e-b769-56717eef6425" returned: 0 in 0.310s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Lock "cinder-quobyte-415906f1-8cfb-431e-b769-56717eef6425" released by "delete_volume" :: held 0.795s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Created reservations ['d17c29b2-8f3a-447b-bab0-a59e091f765b', 'eac03fa8-82d0-43a9-9f30-2ec86da607c9', 'f8c86fa0-9db5-4273-bbdf-4150ee781c4f', 'adb25798-32ae-4d78-9114-dd3ad825f152'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:44 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:36:44 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:45 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.648s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:45 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:36:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Deleted volume successfully. Nov 01 09:36:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2842d301-2185-4804-ab9d-e4bf1c578d7b tempest-VolumeQuotasAdminTestJSON-564800282 None] Lock "cinder-415906f1-8cfb-431e-b769-56717eef6425-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Acquiring lock "cinder-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Lock "cinder-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Acquiring lock "cinder-quobyte-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Lock "cinder-quobyte-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:52 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb7aea5-ac8b-4e20-b432-444316ad9c6a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:52 devstack sudo[92016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d Nov 01 09:36:52 devstack sudo[92016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:53 devstack sudo[92016]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d" returned: 0 in 0.424s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:53 devstack sudo[92021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d Nov 01 09:36:53 devstack sudo[92021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:53 devstack sudo[92023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:36:53 devstack sudo[92023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:53 devstack sudo[92021]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Lock "cinder-quobyte-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d" released by "delete_volume" :: held 0.759s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Created reservations ['55c04225-94c4-43ac-9edc-2362ceb2215c', '0bd2badc-d824-4c8c-9d00-8f6d36a16af4', 'f093b6f5-ac58-42a5-9685-bd0c2913514a', '1012e210-09a3-4231-b754-0d2da03905ad'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:53 devstack sudo[92023]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.295s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:53 devstack sudo[92028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:36:53 devstack sudo[92028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:53 devstack sudo[92028]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.303s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:36:53 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Deleted volume successfully. Nov 01 09:36:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f556b2a3-34bb-4fa5-85cf-c7a595b8ef4e tempest-TaggedAttachmentsTest-796816599 None] Lock "cinder-f034b1c7-d838-4f43-8c70-3ac45ee1cf1d-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Flow 'volume_create_manager' (dc071cda-4acd-4d59-8004-11b42f028aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5305b1a-78fb-4ba0-ba0c-3e1a4b08245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5305b1a-78fb-4ba0-ba0c-3e1a4b08245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1276180428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0996a161-d801-420c-90cd-dbc89d8f3e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdba82fc62904169bbc485fdd6138d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:36:56Z,use_quota=True,user_id='93ac105f31a548568c1f8c512c4531c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce63fd6c-f227-4042-9086-eef176c26d1d),volume_type_id=ce63fd6c-f227-4042-9086-eef176c26d1d)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcadaeb7-1436-4488-8c70-a832b129aad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcadaeb7-1436-4488-8c70-a832b129aad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d0c34e-8ac5-42ed-914c-bc94f859cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d0c34e-8ac5-42ed-914c-bc94f859cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0996a161-d801-420c-90cd-dbc89d8f3e29', 'volume_name': 'volume-0996a161-d801-420c-90cd-dbc89d8f3e29', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654aa089-437d-4108-9b8b-a0f2ed016daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654aa089-437d-4108-9b8b-a0f2ed016daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c461fb5a-ba10-463a-93fc-05b403eedfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:56 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Volume 0996a161-d801-420c-90cd-dbc89d8f3e29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0996a161-d801-420c-90cd-dbc89d8f3e29', 'volume_size': 1} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1276180428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0996a161-d801-420c-90cd-dbc89d8f3e29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdba82fc62904169bbc485fdd6138d08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:36:56Z,use_quota=True,user_id='93ac105f31a548568c1f8c512c4531c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce63fd6c-f227-4042-9086-eef176c26d1d),volume_type_id=ce63fd6c-f227-4042-9086-eef176c26d1d)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Creating volume 0996a161-d801-420c-90cd-dbc89d8f3e29 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:36:56 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:56 devstack sudo[92033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 1073741824 Nov 01 09:36:56 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:56 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 1073741824" returned: 0 in 0.507s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:56 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 Nov 01 09:36:56 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:56 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29" returned: 0 in 0.263s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c461fb5a-ba10-463a-93fc-05b403eedfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0996a161-d801-420c-90cd-dbc89d8f3e29', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4908d385-f0bf-4b71-af29-7fabfbde28c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:36:56 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Volume volume-0996a161-d801-420c-90cd-dbc89d8f3e29 (0996a161-d801-420c-90cd-dbc89d8f3e29): created successfully Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4908d385-f0bf-4b71-af29-7fabfbde28c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:36:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Flow 'volume_create_manager' (dc071cda-4acd-4d59-8004-11b42f028aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:36:56 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-55e27cc5-e713-4f3a-9256-1725779e4372 tempest-VolumeTypesAccessTest-1058546019 None] Created volume successfully. Nov 01 09:36:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Acquiring lock "cinder-0996a161-d801-420c-90cd-dbc89d8f3e29-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Lock "cinder-0996a161-d801-420c-90cd-dbc89d8f3e29-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Acquiring lock "cinder-quobyte-0996a161-d801-420c-90cd-dbc89d8f3e29" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:36:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Lock "cinder-quobyte-0996a161-d801-420c-90cd-dbc89d8f3e29" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:36:58 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[764623b1-6ccf-4815-9f4d-4464c4db3fc2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:36:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:58 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 Nov 01 09:36:58 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:58 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29" returned: 0 in 0.437s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:58 devstack sudo[92049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29 Nov 01 09:36:58 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:59 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0996a161-d801-420c-90cd-dbc89d8f3e29" returned: 0 in 0.361s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Lock "cinder-quobyte-0996a161-d801-420c-90cd-dbc89d8f3e29" released by "delete_volume" :: held 0.868s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:36:59 devstack cinder-volume[86594]: WARNING cinder.quota [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-7676367 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-7676367, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:36:59 devstack cinder-volume[86594]: WARNING cinder.quota [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-7676367 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-7676367, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Created reservations ['671ca82a-4d74-4b9b-a7fc-6c8f275cd581', 'a04a7901-4bb0-4843-bf2c-d663624cdf18', 'd4958822-f66b-43d7-a7a2-57f4a967cf3a', 'acffc1b4-4127-49ce-95ac-104f5d630cef'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:36:59 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:36:59 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:36:59 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.360s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:36:59 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Deleted volume successfully. Nov 01 09:36:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-595c0f2b-3833-433f-bc97-bbf9e6d87b15 tempest-VolumeTypesAccessTest-1058546019 None] Lock "cinder-0996a161-d801-420c-90cd-dbc89d8f3e29-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-47141342-d543-406e-a248-593ffa43bc02 req-b16f73bb-686d-47c0-941d-a16979306ccb tempest-ServerActionsTestOtherA-1951790121 None] Terminate volume connection completed successfully. Nov 01 09:37:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-47141342-d543-406e-a248-593ffa43bc02 req-b16f73bb-686d-47c0-941d-a16979306ccb tempest-ServerActionsTestOtherA-1951790121 None] Deleting attachment 59c64295-bf5a-41e0-9c06-e4b4f8b7f291. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:37:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "cinder-195340a2-c420-4693-9f6a-8aa36202a3b7-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Lock "cinder-195340a2-c420-4693-9f6a-8aa36202a3b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "cinder-quobyte-195340a2-c420-4693-9f6a-8aa36202a3b7" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Lock "cinder-quobyte-195340a2-c420-4693-9f6a-8aa36202a3b7" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:06 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb12a3d-2eb5-46da-b554-8643c8fe13d5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:37:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:06 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 Nov 01 09:37:06 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:07 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7" returned: 0 in 0.659s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:07 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7 Nov 01 09:37:07 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:07 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-195340a2-c420-4693-9f6a-8aa36202a3b7" returned: 0 in 0.319s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Lock "cinder-quobyte-195340a2-c420-4693-9f6a-8aa36202a3b7" released by "delete_volume" :: held 1.043s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG cinder.quota [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Created reservations ['e6d3a6d8-b28f-4c0e-b74b-e440641e6d2b', '54f30f6a-6839-4e6c-9b3f-4a7f1f084db0', '2354d8ff-a604-499b-b295-b12a66156815', '690910dd-e229-41ec-926e-0a3f08bd6112'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:07 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:37:07 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "cinder-704e9ae1-8e6f-4f6c-b761-3231a6f95802-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:08 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.565s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG cinder.manager [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Lock "cinder-704e9ae1-8e6f-4f6c-b761-3231a6f95802-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:08 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Deleted volume successfully. Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-47141342-d543-406e-a248-593ffa43bc02 req-2e7dc10c-7d67-49c1-9139-38cc43d35388 tempest-ServerActionsTestOtherA-1951790121 None] Lock "cinder-195340a2-c420-4693-9f6a-8aa36202a3b7-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "cinder-quobyte-704e9ae1-8e6f-4f6c-b761-3231a6f95802" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Lock "cinder-quobyte-704e9ae1-8e6f-4f6c-b761-3231a6f95802" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[16218555-3b45-4117-8062-55fe589c84e7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:08 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 Nov 01 09:37:08 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:08 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802" returned: 0 in 0.458s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:08 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802 Nov 01 09:37:08 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:09 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-704e9ae1-8e6f-4f6c-b761-3231a6f95802" returned: 0 in 0.332s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Lock "cinder-quobyte-704e9ae1-8e6f-4f6c-b761-3231a6f95802" released by "delete_volume" :: held 0.853s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Created reservations ['437357a0-cf1d-4e3d-a858-34cc648b3eb0', '47120bdd-a9ae-4d34-a944-cb10c0619fad', '4dc05e94-8a37-48c6-afcb-a4eee09b77ad', '7d7fbed2-6558-4b41-86d0-b7494be7da0f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:09 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:37:09 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:09 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.302s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:37:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Deleted volume successfully. Nov 01 09:37:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66aa61e3-d4d1-476c-877e-7b0e22f61e27 tempest-ServerActionsTestOtherA-1951790121 None] Lock "cinder-704e9ae1-8e6f-4f6c-b761-3231a6f95802-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Flow 'volume_create_manager' (74df56a2-eae3-45cc-ad26-fd3b915425ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d136f62a-bc06-4a06-b5b4-4038b3afdef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d136f62a-bc06-4a06-b5b4-4038b3afdef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-282239468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75af5ae5-be24-437e-8ac3-ae90108a23f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab38ef2bdf614c82a825914a3b4d7383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:37:15Z,use_quota=True,user_id='006a7f56021441a683736886abf62978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1281933-8740-4068-a924-b80012e27c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1281933-8740-4068-a924-b80012e27c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada4ecd3-34a8-411b-bbca-2501437e46fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada4ecd3-34a8-411b-bbca-2501437e46fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75af5ae5-be24-437e-8ac3-ae90108a23f0', 'volume_name': 'volume-75af5ae5-be24-437e-8ac3-ae90108a23f0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2616165-4c77-41a5-bcdf-146c37a2fd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2616165-4c77-41a5-bcdf-146c37a2fd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f4a83c-801e-450d-a143-02faa931c5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:15 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Volume 75af5ae5-be24-437e-8ac3-ae90108a23f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75af5ae5-be24-437e-8ac3-ae90108a23f0', 'volume_size': 1} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-282239468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75af5ae5-be24-437e-8ac3-ae90108a23f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab38ef2bdf614c82a825914a3b4d7383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:37:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:37:15Z,use_quota=True,user_id='006a7f56021441a683736886abf62978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Creating volume 75af5ae5-be24-437e-8ac3-ae90108a23f0 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:37:15 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:37:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:15 devstack sudo[92145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 1073741824 Nov 01 09:37:15 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:16 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 1073741824" returned: 0 in 0.558s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:16 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 Nov 01 09:37:16 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:16 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0" returned: 0 in 0.264s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f4a83c-801e-450d-a143-02faa931c5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75af5ae5-be24-437e-8ac3-ae90108a23f0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78020d0c-ae89-4fad-b428-8610ea023bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:16 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Volume volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 (75af5ae5-be24-437e-8ac3-ae90108a23f0): created successfully Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78020d0c-ae89-4fad-b428-8610ea023bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Flow 'volume_create_manager' (74df56a2-eae3-45cc-ad26-fd3b915425ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:37:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-168c2877-2a55-4aec-93d3-4450d8d04b34 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Created volume successfully. Nov 01 09:37:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Creating offline snapshot 38537281-d370-46c6-a66d-440e07b85047 of volume 75af5ae5-be24-437e-8ac3-ae90108a23f0 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:37:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[999052ed-bfcf-4eab-a84f-5b0340572897]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:37:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:18 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 Nov 01 09:37:18 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:18 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0" returned: 0 in 0.461s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:18 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 1G Nov 01 09:37:18 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:18 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 1G" returned: 0 in 0.518s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:18 devstack sudo[92166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 Nov 01 09:37:18 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:19 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:19 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 is being set with open permissions: ugo+rw Nov 01 09:37:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:19 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 Nov 01 09:37:19 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:19 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:19 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.info Nov 01 09:37:19 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:19 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.info" returned: 0 in 0.432s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:19 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.info is being set with open permissions: ugo+rw Nov 01 09:37:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:20 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.info Nov 01 09:37:20 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:20 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.info" returned: 0 in 0.369s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b405bd42-3742-46fb-b715-28cd229c5483 tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Create snapshot completed successfully Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "cinder-38537281-d370-46c6-a66d-440e07b85047-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-38537281-d370-46c6-a66d-440e07b85047-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "cinder-quobyte-75af5ae5-be24-437e-8ac3-ae90108a23f0" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-quobyte-75af5ae5-be24-437e-8ac3-ae90108a23f0" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "cinder-quobyte-38537281-d370-46c6-a66d-440e07b85047" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-quobyte-38537281-d370-46c6-a66d-440e07b85047" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Deleting offline snapshot 38537281-d370-46c6-a66d-440e07b85047 of volume 75af5ae5-be24-437e-8ac3-ae90108a23f0 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] snapshot_file for this snap is: volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[694c796d-1fff-4777-b99a-23f697cf5cc5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:37:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:22 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 Nov 01 09:37:22 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:22 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047" returned: 0 in 0.578s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75af5ae5-be24-437e-8ac3-ae90108a23f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:37:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3652abc1-5b8f-4d29-b084-10384a477621]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:37:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:22 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 Nov 01 09:37:22 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:23 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0" returned: 0 in 0.515s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:23 devstack sudo[92192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 Nov 01 09:37:23 devstack sudo[92192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:23 devstack sudo[92192]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047" returned: 0 in 0.454s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:23 devstack sudo[92197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047 Nov 01 09:37:23 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:23 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0.38537281-d370-46c6-a66d-440e07b85047" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-quobyte-38537281-d370-46c6-a66d-440e07b85047" released by "_delete_snapshot" :: held 2.020s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-quobyte-75af5ae5-be24-437e-8ac3-ae90108a23f0" released by "delete_snapshot" :: held 2.066s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:24 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Created reservations ['0e1cde76-475f-4087-81a4-819c160748fb', '34276df9-e88d-4878-a24f-48f2fc3d6773', 'aea791cd-1ffa-4a04-ba04-21d471078204', 'e9d9810a-9e00-47da-887a-20ff6d483037'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:37:24 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Delete snapshot completed successfully. Nov 01 09:37:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0736002d-5a2d-429f-a4d4-c3cf7547687b tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-38537281-d370-46c6-a66d-440e07b85047-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "cinder-75af5ae5-be24-437e-8ac3-ae90108a23f0-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-75af5ae5-be24-437e-8ac3-ae90108a23f0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "cinder-quobyte-75af5ae5-be24-437e-8ac3-ae90108a23f0" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-quobyte-75af5ae5-be24-437e-8ac3-ae90108a23f0" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:25 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e39f0d4-1cd2-4e25-9e5c-a1a22dcfc418]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:37:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:25 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 Nov 01 09:37:25 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:26 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0" returned: 0 in 0.568s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:26 devstack sudo[92206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0 Nov 01 09:37:26 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:26 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-75af5ae5-be24-437e-8ac3-ae90108a23f0" returned: 0 in 0.317s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-quobyte-75af5ae5-be24-437e-8ac3-ae90108a23f0" released by "delete_volume" :: held 0.982s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Created reservations ['bb10979e-37b0-4332-8d02-2e49ba6cba4f', 'fc6ce8ad-e0f1-42f5-a5de-4c7d26b5fdf6', 'f1aba382-9914-4826-96b8-a6f78aa82e07', '9d6a4c9e-a05e-4cd0-be52-a3eacd258e83'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:26 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:37:26 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:26 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.292s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:37:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Deleted volume successfully. Nov 01 09:37:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aa3c5362-8f29-4553-b010-811f719a7d8c tempest-VolumeSnapshotQuotasNegativeTestJSON-526619725 None] Lock "cinder-75af5ae5-be24-437e-8ac3-ae90108a23f0-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Flow 'volume_create_manager' (d77cea0b-8b89-47c8-9f8d-4f9dc4be120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbeb9ec-bdc8-45f0-a739-6d4414252108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbeb9ec-bdc8-45f0-a739-6d4414252108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-887694358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3cfda3f-0f74-4d4a-8186-b64d3d7a834b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13be92a36e4baf85817d57ef888052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:37:29Z,use_quota=True,user_id='bc39f836a3444907810e5b37028886d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba3cf21-92d8-4037-b737-36d42c4b45c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba3cf21-92d8-4037-b737-36d42c4b45c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7020433-ebd1-4dd9-80ba-7d4cd9bc35d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7020433-ebd1-4dd9-80ba-7d4cd9bc35d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3cfda3f-0f74-4d4a-8186-b64d3d7a834b', 'volume_name': 'volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90eb055a-5513-4923-89e1-a79a885bd6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90eb055a-5513-4923-89e1-a79a885bd6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f6118e-abda-4d0d-8b83-bb34e6f16430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:29 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Volume e3cfda3f-0f74-4d4a-8186-b64d3d7a834b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b', 'volume_size': 1} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-887694358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3cfda3f-0f74-4d4a-8186-b64d3d7a834b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f13be92a36e4baf85817d57ef888052',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:37:29Z,use_quota=True,user_id='bc39f836a3444907810e5b37028886d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Creating volume e3cfda3f-0f74-4d4a-8186-b64d3d7a834b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:37:29 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:37:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:29 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b 1073741824 Nov 01 09:37:29 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:30 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b 1073741824" returned: 0 in 0.785s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=70,cinder:INSERT=22,cinder:UPDATE=93,cinder:DELETE=8 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=82,cinder:INSERT=24,cinder:UPDATE=96,cinder:DELETE=4 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:30 devstack sudo[92232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b Nov 01 09:37:30 devstack sudo[92232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:30 devstack sudo[92232]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b" returned: 0 in 0.354s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76f6118e-abda-4d0d-8b83-bb34e6f16430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bc2f77-7f35-4239-9aa8-2834999179c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Volume volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b (e3cfda3f-0f74-4d4a-8186-b64d3d7a834b): created successfully Nov 01 09:37:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bc2f77-7f35-4239-9aa8-2834999179c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Flow 'volume_create_manager' (d77cea0b-8b89-47c8-9f8d-4f9dc4be120b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:37:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2f6584a1-ee26-43e3-b9fa-ffefb53e467b tempest-AbsoluteLimitsTests-1879756109 None] Created volume successfully. Nov 01 09:37:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Acquiring lock "cinder-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Lock "cinder-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Acquiring lock "cinder-quobyte-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Lock "cinder-quobyte-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3baab19-49c5-4ae0-bf3f-2bfab8d32863]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:32 devstack sudo[92250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b Nov 01 09:37:32 devstack sudo[92250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:32 devstack sudo[92250]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b" returned: 0 in 0.448s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:32 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b Nov 01 09:37:32 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:32 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b" returned: 0 in 0.322s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Lock "cinder-quobyte-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b" released by "delete_volume" :: held 0.821s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:32 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Created reservations ['a40b7d56-6888-41f6-aa30-33345389f2ef', 'd3eda59c-38bf-4d9c-a2a5-1da60d4ad335', '8fe86feb-1435-492e-81aa-04f99aa2c5b9', '0ea586b0-ce9c-4f04-8562-2edced277e99'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:33 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:37:33 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:33 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.290s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:37:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Deleted volume successfully. Nov 01 09:37:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-22785cd4-7ee9-4015-9e63-d8b8b7eb017b tempest-AbsoluteLimitsTests-1879756109 None] Lock "cinder-e3cfda3f-0f74-4d4a-8186-b64d3d7a834b-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:37:43 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:37:43 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=8,cinder:SELECT=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:37:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:37:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:37:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:37:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:53 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:37:53 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:54 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.985s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:54 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:37:54 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:37:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:37:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Flow 'volume_create_manager' (5ccf104d-97b2-45f0-ac39-2ed8e01ec65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69812e1-6375-429b-9640-a509fdf7ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69812e1-6375-429b-9640-a509fdf7ac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1011199630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a1e186-8405-462f-8e91-a8a7a95f6a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642539f99cea4b4f920afe3ab3e173f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:37:56Z,use_quota=True,user_id='1c0076bc42cd4b3390ffa5389cd015f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68675142-fcbb-4e2c-bb8a-56dc3a96ff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68675142-fcbb-4e2c-bb8a-56dc3a96ff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b1792-ff64-4e74-b7f7-3f90d238da2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8b1792-ff64-4e74-b7f7-3f90d238da2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47a1e186-8405-462f-8e91-a8a7a95f6a3b', 'volume_name': 'volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d54679a-7a6e-4259-83d1-7184304caec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d54679a-7a6e-4259-83d1-7184304caec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26eba61-ecfc-4737-a884-5d97d39c03c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:56 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Volume 47a1e186-8405-462f-8e91-a8a7a95f6a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b', 'volume_size': 1} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1011199630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47a1e186-8405-462f-8e91-a8a7a95f6a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642539f99cea4b4f920afe3ab3e173f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:37:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:37:56Z,use_quota=True,user_id='1c0076bc42cd4b3390ffa5389cd015f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Creating volume 47a1e186-8405-462f-8e91-a8a7a95f6a3b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:37:56 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:37:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:56 devstack sudo[92570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b 1073741824 Nov 01 09:37:56 devstack sudo[92570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:57 devstack sudo[92570]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b 1073741824" returned: 0 in 1.094s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:37:58 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b Nov 01 09:37:58 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:37:58 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Nov 01 09:37:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b" returned: 0 in 0.727s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:37:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:37:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:37:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26eba61-ecfc-4737-a884-5d97d39c03c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe17a47-2f63-41f0-bb95-3413f937c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:37:58 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Volume volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b (47a1e186-8405-462f-8e91-a8a7a95f6a3b): created successfully Nov 01 09:37:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe17a47-2f63-41f0-bb95-3413f937c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:37:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Flow 'volume_create_manager' (5ccf104d-97b2-45f0-ac39-2ed8e01ec65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:37:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-84f08be3-3a4b-4985-948f-e3fae242013e tempest-VolumesListAdminTestJSON-1822947858 None] Created volume successfully. Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Flow 'volume_create_manager' (835dd0b0-2c98-4e69-a997-2717441b5022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1fb14e-7a6a-4ba8-8634-9ecff9c087a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1fb14e-7a6a-4ba8-8634-9ecff9c087a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1167035978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ee21cf-e428-4886-b078-6529c3c97383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642539f99cea4b4f920afe3ab3e173f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:02Z,use_quota=True,user_id='1c0076bc42cd4b3390ffa5389cd015f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe271b80-d181-4888-b256-9cae0047af9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe271b80-d181-4888-b256-9cae0047af9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87ce8c6-368a-4b53-bf99-204393feac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87ce8c6-368a-4b53-bf99-204393feac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ee21cf-e428-4886-b078-6529c3c97383', 'volume_name': 'volume-f6ee21cf-e428-4886-b078-6529c3c97383', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a87bbb-0b84-4344-a5c8-2042c9ac6c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7a87bbb-0b84-4344-a5c8-2042c9ac6c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2b96a2-2b37-49ea-b347-a5a3aff53afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:02 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Volume f6ee21cf-e428-4886-b078-6529c3c97383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ee21cf-e428-4886-b078-6529c3c97383', 'volume_size': 1} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1167035978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ee21cf-e428-4886-b078-6529c3c97383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642539f99cea4b4f920afe3ab3e173f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:02Z,use_quota=True,user_id='1c0076bc42cd4b3390ffa5389cd015f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Creating volume f6ee21cf-e428-4886-b078-6529c3c97383 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:38:02 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:02 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 1073741824 Nov 01 09:38:02 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Flow 'volume_create_manager' (e1d4ceff-ec5e-4993-a2a4-7f5208bbe62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00968e71-7c76-45e7-b9c7-4b0ab9ad5311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00968e71-7c76-45e7-b9c7-4b0ab9ad5311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1201233996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa1bb86-e0e5-446c-99db-d675fb3de8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c39357ce9c4154ab44a2782834e6ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:02Z,use_quota=True,user_id='d87fce3a8bb748fe90c3b1857af100eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b327c3-a984-4f05-979b-135d77d96808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b327c3-a984-4f05-979b-135d77d96808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76512687-4bc0-4d8c-abfe-b92fa6d96ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76512687-4bc0-4d8c-abfe-b92fa6d96ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fa1bb86-e0e5-446c-99db-d675fb3de8cb', 'volume_name': 'volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b234f9e3-0b2f-4e3d-aa1f-7345a8b01f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b234f9e3-0b2f-4e3d-aa1f-7345a8b01f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69573f0f-ddbf-457a-a391-c0be3126d59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:02 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Volume 7fa1bb86-e0e5-446c-99db-d675fb3de8cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb', 'volume_size': 1} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:02 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 1073741824" returned: 0 in 0.777s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:02 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 Nov 01 09:38:02 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:03 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383" returned: 0 in 0.283s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1201233996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fa1bb86-e0e5-446c-99db-d675fb3de8cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c39357ce9c4154ab44a2782834e6ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:02Z,use_quota=True,user_id='d87fce3a8bb748fe90c3b1857af100eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Creating volume 7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:38:03 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2b96a2-2b37-49ea-b347-a5a3aff53afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ee21cf-e428-4886-b078-6529c3c97383', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:03 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb 1073741824 Nov 01 09:38:03 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a75d6a-a9a3-45a2-b660-23a98259c647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:03 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Volume volume-f6ee21cf-e428-4886-b078-6529c3c97383 (f6ee21cf-e428-4886-b078-6529c3c97383): created successfully Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a75d6a-a9a3-45a2-b660-23a98259c647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Flow 'volume_create_manager' (835dd0b0-2c98-4e69-a997-2717441b5022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:03 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-04b777b0-51e5-42a0-a808-9d567b23210b tempest-VolumesListAdminTestJSON-1822947858 None] Created volume successfully. Nov 01 09:38:03 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb 1073741824" returned: 0 in 0.571s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:03 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:38:03 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:04 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.395s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69573f0f-ddbf-457a-a391-c0be3126d59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa68178-6229-4846-b6d0-960f700141ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Volume volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb (7fa1bb86-e0e5-446c-99db-d675fb3de8cb): created successfully Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa68178-6229-4846-b6d0-960f700141ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Flow 'volume_create_manager' (e1d4ceff-ec5e-4993-a2a4-7f5208bbe62b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:04 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-47d3d28e-330c-433d-817b-ec97684eed6f tempest-VolumesActionsTest-389134428 None] Created volume successfully. Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Flow 'volume_create_manager' (7cdca436-f64b-4c5e-b014-94f5e2a58ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be5a5f7-45b2-48a2-84c8-c1d2fb36e4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2be5a5f7-45b2-48a2-84c8-c1d2fb36e4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1559233469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eae4ec6-a25e-4eee-882a-82ff64ef66d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642539f99cea4b4f920afe3ab3e173f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:04Z,use_quota=True,user_id='1c0076bc42cd4b3390ffa5389cd015f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbc271a-89ac-413d-9a01-a3d6cb885500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acbc271a-89ac-413d-9a01-a3d6cb885500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839a0fe1-003c-4e79-930a-1003aecd72e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839a0fe1-003c-4e79-930a-1003aecd72e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eae4ec6-a25e-4eee-882a-82ff64ef66d0', 'volume_name': 'volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77faa8cc-c7ef-41a9-a948-488baf42a427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77faa8cc-c7ef-41a9-a948-488baf42a427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caafb36-62a1-4e43-bd18-3ba550b64661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Volume 9eae4ec6-a25e-4eee-882a-82ff64ef66d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0', 'volume_size': 1} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1559233469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eae4ec6-a25e-4eee-882a-82ff64ef66d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='642539f99cea4b4f920afe3ab3e173f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:04Z,use_quota=True,user_id='1c0076bc42cd4b3390ffa5389cd015f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Creating volume 9eae4ec6-a25e-4eee-882a-82ff64ef66d0 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:38:04 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:38:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:04 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 1073741824 Nov 01 09:38:04 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:05 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 1073741824" returned: 0 in 0.685s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:05 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 Nov 01 09:38:05 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Flow 'volume_create_manager' (3ff19c03-032a-44b4-87e4-ac9605176a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66aa2df-cb1a-4753-a13e-b42f5c3fa57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66aa2df-cb1a-4753-a13e-b42f5c3fa57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1315424531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c20dc3-e629-4813-8997-f0f6cb8515c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee1cb0a3efb410db4609f601416fea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:05Z,use_quota=True,user_id='d5fdbfcae9e0476081038f3e372cde6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228e52db-f652-4dca-af13-ce711768573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228e52db-f652-4dca-af13-ce711768573e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467bde66-eb27-4b1b-bfb4-f5b467e7ef3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (467bde66-eb27-4b1b-bfb4-f5b467e7ef3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c20dc3-e629-4813-8997-f0f6cb8515c2', 'volume_name': 'volume-18c20dc3-e629-4813-8997-f0f6cb8515c2', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965b5177-8eb3-47ca-8049-7aae89dae256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965b5177-8eb3-47ca-8049-7aae89dae256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d79dbf1-d5e7-4387-9f93-7250040215ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:05 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Volume 18c20dc3-e629-4813-8997-f0f6cb8515c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c20dc3-e629-4813-8997-f0f6cb8515c2', 'volume_size': 1} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:05 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0" returned: 0 in 0.611s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1315424531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c20dc3-e629-4813-8997-f0f6cb8515c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee1cb0a3efb410db4609f601416fea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:05Z,use_quota=True,user_id='d5fdbfcae9e0476081038f3e372cde6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Creating volume 18c20dc3-e629-4813-8997-f0f6cb8515c2 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:38:05 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caafb36-62a1-4e43-bd18-3ba550b64661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb108ec-33d3-4133-bebc-bfb62066677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:05 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 1073741824 Nov 01 09:38:05 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:05 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Volume volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 (9eae4ec6-a25e-4eee-882a-82ff64ef66d0): created successfully Nov 01 09:38:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb108ec-33d3-4133-bebc-bfb62066677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Flow 'volume_create_manager' (7cdca436-f64b-4c5e-b014-94f5e2a58ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9566b879-4131-4705-8fee-9f18f6eb68ca tempest-VolumesListAdminTestJSON-1822947858 None] Created volume successfully. Nov 01 09:38:06 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 1073741824" returned: 0 in 0.837s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:06 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 Nov 01 09:38:06 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:07 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2" returned: 0 in 0.555s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d79dbf1-d5e7-4387-9f93-7250040215ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c20dc3-e629-4813-8997-f0f6cb8515c2', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1a4f3d-df1b-451f-8361-429eb0a1b481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:07 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Volume volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 (18c20dc3-e629-4813-8997-f0f6cb8515c2): created successfully Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1a4f3d-df1b-451f-8361-429eb0a1b481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Flow 'volume_create_manager' (3ff19c03-032a-44b4-87e4-ac9605176a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:07 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a1d37b66-70e5-4a14-be1f-384b3ae9e134 tempest-AttachVolumeTestJSON-1801423078 None] Created volume successfully. Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Flow 'volume_create_manager' (e20094ad-f084-45dc-a16f-30c8ccd96a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5fa281-70c2-4d25-8809-4f525e2274d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd5fa281-70c2-4d25-8809-4f525e2274d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-404654508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9b42af-1a58-4a2d-9e70-ec777068b40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2925f071d74d22b3bc6048cb26c1c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:08Z,use_quota=True,user_id='052c2ee0aef34f54b5dee2fc62c0c9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb4ccb1-3fe3-4f4c-b5fe-23deb5f1ed86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb4ccb1-3fe3-4f4c-b5fe-23deb5f1ed86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe85291-bb21-4639-8380-320ea7fca12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe85291-bb21-4639-8380-320ea7fca12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9b42af-1a58-4a2d-9e70-ec777068b40a', 'volume_name': 'volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fa2fe3-2b88-4ee9-b2ab-36b2debc354d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01fa2fe3-2b88-4ee9-b2ab-36b2debc354d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c4f7a7-6e01-4fad-beac-d8db4dcb3aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Volume 4c9b42af-1a58-4a2d-9e70-ec777068b40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a', 'volume_size': 1} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-404654508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9b42af-1a58-4a2d-9e70-ec777068b40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2925f071d74d22b3bc6048cb26c1c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:08Z,use_quota=True,user_id='052c2ee0aef34f54b5dee2fc62c0c9bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Creating volume 4c9b42af-1a58-4a2d-9e70-ec777068b40a {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:38:08 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:08 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a 1073741824 Nov 01 09:38:08 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Flow 'volume_create_manager' (c02735c6-8152-4708-b01b-254ea4da07d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3e96f4-2359-436c-8ddf-5811f03895e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad3e96f4-2359-436c-8ddf-5811f03895e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f676f1-4635-4de7-9ef0-a988b05f3289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e75fd511582244e18b20827808d74c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:08Z,use_quota=True,user_id='2a81d89f20494476a2f799da9331a285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4924f3-0147-4b88-bd5a-0235f3ebec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4924f3-0147-4b88-bd5a-0235f3ebec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ede53a-04ff-4342-b0a1-407e02f4eb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3ede53a-04ff-4342-b0a1-407e02f4eb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f676f1-4635-4de7-9ef0-a988b05f3289', 'volume_name': 'volume-c1f676f1-4635-4de7-9ef0-a988b05f3289', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74db8a4-fcd6-4755-abab-5996cd96069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74db8a4-fcd6-4755-abab-5996cd96069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198a8ab1-75ec-46b1-a52e-deacba137611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:08 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Volume c1f676f1-4635-4de7-9ef0-a988b05f3289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f676f1-4635-4de7-9ef0-a988b05f3289', 'volume_size': 1} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:08 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a 1073741824" returned: 0 in 0.750s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:08 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a Nov 01 09:38:08 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:09 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a" returned: 0 in 0.387s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1f676f1-4635-4de7-9ef0-a988b05f3289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e75fd511582244e18b20827808d74c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:08Z,use_quota=True,user_id='2a81d89f20494476a2f799da9331a285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Creating volume c1f676f1-4635-4de7-9ef0-a988b05f3289 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:38:09 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c4f7a7-6e01-4fad-beac-d8db4dcb3aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf10150-5688-4b54-b3fd-f853f4b0f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:09 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 1073741824 Nov 01 09:38:09 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Volume volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a (4c9b42af-1a58-4a2d-9e70-ec777068b40a): created successfully Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf10150-5688-4b54-b3fd-f853f4b0f306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Flow 'volume_create_manager' (e20094ad-f084-45dc-a16f-30c8ccd96a80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7b97d769-f9df-4e03-9efa-5e4a655d7d35 tempest-ServerRescueNegativeTestJSON-1692039680 None] Created volume successfully. Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-5e199670-9aa2-4e4e-b59b-fc744c534749 req-aa57df61-e51e-4a3e-b77c-002e8020f472 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:10 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 1073741824" returned: 0 in 0.891s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:10 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 Nov 01 09:38:10 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:10 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289" returned: 0 in 0.531s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-5e199670-9aa2-4e4e-b59b-fc744c534749 req-aa57df61-e51e-4a3e-b77c-002e8020f472 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.643s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-5e199670-9aa2-4e4e-b59b-fc744c534749 req-aa57df61-e51e-4a3e-b77c-002e8020f472 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198a8ab1-75ec-46b1-a52e-deacba137611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f676f1-4635-4de7-9ef0-a988b05f3289', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa34daa1-2f80-4fb1-acb2-4caf4ae496f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:10 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Volume volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 (c1f676f1-4635-4de7-9ef0-a988b05f3289): created successfully Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa34daa1-2f80-4fb1-acb2-4caf4ae496f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Flow 'volume_create_manager' (c02735c6-8152-4708-b01b-254ea4da07d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-5e199670-9aa2-4e4e-b59b-fc744c534749 req-aa57df61-e51e-4a3e-b77c-002e8020f472 tempest-AttachVolumeTestJSON-1801423078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-18c20dc3-e629-4813-8997-f0f6cb8515c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0f3c280-d6ef-42f2-8b99-e637d1824001', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:38:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-58eed74b-cd62-4cdb-a16b-30272f8fb099 tempest-VolumesListAdminTestJSON-410371889 None] Created volume successfully. Nov 01 09:38:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-5e199670-9aa2-4e4e-b59b-fc744c534749 req-aa57df61-e51e-4a3e-b77c-002e8020f472 tempest-AttachVolumeTestJSON-1801423078 None] attachment_update completed successfully. Nov 01 09:38:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Acquiring lock "cinder-c1f676f1-4635-4de7-9ef0-a988b05f3289-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Lock "cinder-c1f676f1-4635-4de7-9ef0-a988b05f3289-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Acquiring lock "cinder-quobyte-c1f676f1-4635-4de7-9ef0-a988b05f3289" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Lock "cinder-quobyte-c1f676f1-4635-4de7-9ef0-a988b05f3289" acquired by "delete_volume" :: waited 0.043s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:11 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f134d75f-4eb5-4475-ac72-d7725cb29ddb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "cinder-9eae4ec6-a25e-4eee-882a-82ff64ef66d0-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-9eae4ec6-a25e-4eee-882a-82ff64ef66d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "cinder-quobyte-9eae4ec6-a25e-4eee-882a-82ff64ef66d0" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-quobyte-9eae4ec6-a25e-4eee-882a-82ff64ef66d0" acquired by "delete_volume" :: waited 0.046s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:12 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ac58cf-cdc2-4c91-8748-1b0fe6fc531f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:12 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 Nov 01 09:38:12 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:12 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 Nov 01 09:38:12 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:12 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289" returned: 0 in 0.892s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:12 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289 Nov 01 09:38:12 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:13 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0" returned: 0 in 0.795s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:13 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0 Nov 01 09:38:13 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:13 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9eae4ec6-a25e-4eee-882a-82ff64ef66d0" returned: 0 in 0.498s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-quobyte-9eae4ec6-a25e-4eee-882a-82ff64ef66d0" released by "delete_volume" :: held 1.390s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:13 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c1f676f1-4635-4de7-9ef0-a988b05f3289" returned: 0 in 0.789s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Lock "cinder-quobyte-c1f676f1-4635-4de7-9ef0-a988b05f3289" released by "delete_volume" :: held 1.802s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Created reservations ['36601622-8fad-4032-8d3c-c62ec22657c9', 'd9d7a4c4-22c4-4d0d-9f07-622cb737d3de', '033557cc-caf1-45c2-bde2-3e51e36e0e8c', '7c2cf081-19c9-46ab-96bd-ebef3790d61d'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Created reservations ['4c5cf6d6-530e-421d-b05f-bad447535ab2', '37ec1188-42b8-4e57-95c5-a19be465a1dc', 'ecb8087d-be3c-4428-abe5-86cd263dcb40', '29ae36e2-4835-4dc8-a0de-1a30f91530d6'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:14 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:38:14 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:14 devstack sudo[93205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:38:14 devstack sudo[93205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:14 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.716s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:38:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Deleted volume successfully. Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fecb101-002f-4f35-8885-b59830360a4a tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-9eae4ec6-a25e-4eee-882a-82ff64ef66d0-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.687s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:38:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Deleted volume successfully. Nov 01 09:38:14 devstack sudo[93205]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-64f0e4e4-95bd-4e37-88d8-529b82f64799 tempest-VolumesListAdminTestJSON-410371889 None] Lock "cinder-c1f676f1-4635-4de7-9ef0-a988b05f3289-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "cinder-f6ee21cf-e428-4886-b078-6529c3c97383-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-f6ee21cf-e428-4886-b078-6529c3c97383-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "cinder-quobyte-f6ee21cf-e428-4886-b078-6529c3c97383" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-quobyte-f6ee21cf-e428-4886-b078-6529c3c97383" acquired by "delete_volume" :: waited 0.049s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9998abc-32ac-4594-b5a0-6c9774ff44dd]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:15 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 Nov 01 09:38:15 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:16 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383" returned: 0 in 0.895s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:16 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383 Nov 01 09:38:16 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:17 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f6ee21cf-e428-4886-b078-6529c3c97383" returned: 0 in 0.763s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-quobyte-f6ee21cf-e428-4886-b078-6529c3c97383" released by "delete_volume" :: held 1.803s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Created reservations ['bce4a98d-086e-46f8-9fd0-8c528061cb21', '42f183dd-6a64-4454-bafa-6e669c6cddd1', '41e6813d-d37b-42d3-9cfa-c5f64a0f010d', 'd6c3ed47-c9de-484e-9c94-d183d5789a0a'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:17 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:38:17 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "cinder-47a1e186-8405-462f-8e91-a8a7a95f6a3b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-47a1e186-8405-462f-8e91-a8a7a95f6a3b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "cinder-quobyte-47a1e186-8405-462f-8e91-a8a7a95f6a3b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-quobyte-47a1e186-8405-462f-8e91-a8a7a95f6a3b" acquired by "delete_volume" :: waited 0.056s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:18 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.955s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:38:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Deleted volume successfully. Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb71068-fc51-459e-9273-39e4c1d6581d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-71908249-ccdf-4b6f-a1e9-5c49cdf183ee tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-f6ee21cf-e428-4886-b078-6529c3c97383-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:18 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b Nov 01 09:38:18 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:19 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b" returned: 0 in 0.729s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:19 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b Nov 01 09:38:19 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1226d840-8004-4a39-9074-c412f57cc030 tempest-VolumesActionsTest-389134428 None] Acquiring lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" by "attach_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:20 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-47a1e186-8405-462f-8e91-a8a7a95f6a3b" returned: 0 in 0.724s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-quobyte-47a1e186-8405-462f-8e91-a8a7a95f6a3b" released by "delete_volume" :: held 1.633s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1226d840-8004-4a39-9074-c412f57cc030 tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" acquired by "attach_volume" :: waited 0.124s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Created reservations ['6c3efeb1-e57b-4412-bc05-64d9b00cf75b', '0eff574e-8028-4686-9afc-4193595730c0', '2fba574f-7ef9-492e-9876-b6dfe2703a8a', '86d7d5cf-a549-42c4-8cde-5380108532c0'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:38:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1226d840-8004-4a39-9074-c412f57cc030 tempest-VolumesActionsTest-389134428 None] Attaching volume 7fa1bb86-e0e5-446c-99db-d675fb3de8cb to instance 2084d87b-8668-486e-a3d2-d58f219abf87 at mountpoint /dev/vdb on host None. Nov 01 09:38:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1226d840-8004-4a39-9074-c412f57cc030 tempest-VolumesActionsTest-389134428 None] Attach volume completed successfully. Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1226d840-8004-4a39-9074-c412f57cc030 tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" released by "attach_volume" :: held 0.640s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:20 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:38:20 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e9fbdc36-fba1-4f52-ab0a-0f36602fa8f6 tempest-VolumesActionsTest-389134428 None] Acquiring lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-detach_volume" by "detach_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e9fbdc36-fba1-4f52-ab0a-0f36602fa8f6 tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-detach_volume" acquired by "detach_volume" :: waited 0.094s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e9fbdc36-fba1-4f52-ab0a-0f36602fa8f6 tempest-VolumesActionsTest-389134428 None] Detaching volume 7fa1bb86-e0e5-446c-99db-d675fb3de8cb from instance 2084d87b-8668-486e-a3d2-d58f219abf87. Nov 01 09:38:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e9fbdc36-fba1-4f52-ab0a-0f36602fa8f6 tempest-VolumesActionsTest-389134428 None] Detach volume completed successfully. Nov 01 09:38:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e9fbdc36-fba1-4f52-ab0a-0f36602fa8f6 tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-detach_volume" released by "detach_volume" :: held 0.361s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:21 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 1.053s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:21 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:38:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Deleted volume successfully. Nov 01 09:38:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-db0332d4-14a0-4876-a1a6-70d8ad8a0c9f tempest-VolumesListAdminTestJSON-1822947858 None] Lock "cinder-47a1e186-8405-462f-8e91-a8a7a95f6a3b-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Acquiring lock "cinder-4c9b42af-1a58-4a2d-9e70-ec777068b40a-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "cinder-4c9b42af-1a58-4a2d-9e70-ec777068b40a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Acquiring lock "cinder-quobyte-4c9b42af-1a58-4a2d-9e70-ec777068b40a" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "cinder-quobyte-4c9b42af-1a58-4a2d-9e70-ec777068b40a" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf352c2-4a3f-46a5-81be-c2f2127cc0c2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:28 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a Nov 01 09:38:28 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:29 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a" returned: 0 in 0.683s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:29 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a Nov 01 09:38:29 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:29 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c9b42af-1a58-4a2d-9e70-ec777068b40a" returned: 0 in 0.579s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "cinder-quobyte-4c9b42af-1a58-4a2d-9e70-ec777068b40a" released by "delete_volume" :: held 1.391s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:29 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Created reservations ['3bd5e71f-a411-44bd-958c-d3c923bb7710', '6d7e4335-5a15-479c-a2a0-f358c3744c5b', 'e11ed991-350c-4db7-8e6c-9e935fcdce4c', '2023e03e-4824-4af0-80db-48e75b5e4f93'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:30 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:38:30 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:30 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.656s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:38:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Deleted volume successfully. Nov 01 09:38:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3c671374-1eb2-4a8f-aa06-8571da77ddd8 tempest-ServerRescueNegativeTestJSON-1692039680 None] Lock "cinder-4c9b42af-1a58-4a2d-9e70-ec777068b40a-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:41 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=69,cinder:SELECT=46,cinder:DELETE=6,cinder:INSERT=16 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:38:41 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=59,cinder:INSERT=13,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Flow 'volume_create_manager' (a740dbad-9965-4d10-9ab3-ac6420c4e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae84af9-5b25-4b2f-93f7-fa1815048a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae84af9-5b25-4b2f-93f7-fa1815048a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1523395796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d5a494-1930-4d49-8621-a217a8b92ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5f2a0d8ef4c739960556fcc2ee1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:44Z,use_quota=True,user_id='7bc0d9c63bcc4897948c959912ee7d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaca4ef-bff2-4286-8898-20262901b84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaca4ef-bff2-4286-8898-20262901b84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaa1a36-c631-48b8-b594-d2f34a00b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaa1a36-c631-48b8-b594-d2f34a00b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d5a494-1930-4d49-8621-a217a8b92ae7', 'volume_name': 'volume-66d5a494-1930-4d49-8621-a217a8b92ae7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374af4bb-9234-4cb7-9fea-e8232e6ae9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374af4bb-9234-4cb7-9fea-e8232e6ae9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66a4cf4-e6ad-4970-badb-e016630ce813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:44 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Volume 66d5a494-1930-4d49-8621-a217a8b92ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d5a494-1930-4d49-8621-a217a8b92ae7', 'volume_size': 1} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1523395796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66d5a494-1930-4d49-8621-a217a8b92ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5f2a0d8ef4c739960556fcc2ee1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:44Z,use_quota=True,user_id='7bc0d9c63bcc4897948c959912ee7d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Creating volume 66d5a494-1930-4d49-8621-a217a8b92ae7 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:38:44 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:44 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 1073741824 Nov 01 09:38:44 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3131aa7d-0117-414b-a094-019bf84b1f5d tempest-VolumesActionsTest-389134428 None] Acquiring lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" by "attach_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3131aa7d-0117-414b-a094-019bf84b1f5d tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" acquired by "attach_volume" :: waited 0.047s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:44 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3131aa7d-0117-414b-a094-019bf84b1f5d tempest-VolumesActionsTest-389134428 None] Attaching volume 7fa1bb86-e0e5-446c-99db-d675fb3de8cb to instance a006f874-0875-407a-95d9-50b2af0b96a4 at mountpoint /dev/vdb on host None. Nov 01 09:38:44 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3131aa7d-0117-414b-a094-019bf84b1f5d tempest-VolumesActionsTest-389134428 None] Attach volume completed successfully. Nov 01 09:38:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3131aa7d-0117-414b-a094-019bf84b1f5d tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" released by "attach_volume" :: held 0.137s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:45 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 1073741824" returned: 0 in 0.608s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:45 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 Nov 01 09:38:45 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4adcc549-1b27-483f-bc49-32b79cb0dee6 tempest-VolumesActionsTest-389134428 None] Acquiring lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-detach_volume" by "detach_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4adcc549-1b27-483f-bc49-32b79cb0dee6 tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4adcc549-1b27-483f-bc49-32b79cb0dee6 tempest-VolumesActionsTest-389134428 None] Detaching volume 7fa1bb86-e0e5-446c-99db-d675fb3de8cb from instance a006f874-0875-407a-95d9-50b2af0b96a4. Nov 01 09:38:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4adcc549-1b27-483f-bc49-32b79cb0dee6 tempest-VolumesActionsTest-389134428 None] Detach volume completed successfully. Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4adcc549-1b27-483f-bc49-32b79cb0dee6 tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:45 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7" returned: 0 in 0.325s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66a4cf4-e6ad-4970-badb-e016630ce813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d5a494-1930-4d49-8621-a217a8b92ae7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925b3df6-d140-4399-a712-5205b17d54a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:45 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Volume volume-66d5a494-1930-4d49-8621-a217a8b92ae7 (66d5a494-1930-4d49-8621-a217a8b92ae7): created successfully Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925b3df6-d140-4399-a712-5205b17d54a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Flow 'volume_create_manager' (a740dbad-9965-4d10-9ab3-ac6420c4e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-188f6ca2-c84f-4cff-9c05-e85040f97143 tempest-VolumesTransfersV357Test-766672593 None] Created volume successfully. Nov 01 09:38:47 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fc5d3a29-3900-4e21-8053-a6fd3be3972b tempest-VolumesTransfersV357Test-1362466205 None] Transfer volume completed successfully. Nov 01 09:38:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Acquiring lock "cinder-66d5a494-1930-4d49-8621-a217a8b92ae7-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Lock "cinder-66d5a494-1930-4d49-8621-a217a8b92ae7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Acquiring lock "cinder-quobyte-66d5a494-1930-4d49-8621-a217a8b92ae7" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Lock "cinder-quobyte-66d5a494-1930-4d49-8621-a217a8b92ae7" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[78528bbf-f4ca-4cbe-a9e9-7102ea2f55c7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:48 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 Nov 01 09:38:48 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:49 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7" returned: 0 in 0.483s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:49 devstack sudo[94222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7 Nov 01 09:38:49 devstack sudo[94222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:49 devstack sudo[94222]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-66d5a494-1930-4d49-8621-a217a8b92ae7" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Lock "cinder-quobyte-66d5a494-1930-4d49-8621-a217a8b92ae7" released by "delete_volume" :: held 0.852s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Created reservations ['52543b51-5318-47f0-9f35-9b558d3438b0', 'a606ef06-9295-4541-892c-9ae5b96f8838', 'fd59e03b-a209-4303-95fd-e551be77b5cf', '6f04606f-351a-421e-8dbe-847d4fb35346'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:49 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:38:49 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:50 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.343s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:38:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Deleted volume successfully. Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0a5ea4a6-71c5-4d0c-95fa-ed16e3b0484c tempest-VolumesTransfersV357Test-393393907 None] Lock "cinder-66d5a494-1930-4d49-8621-a217a8b92ae7-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Flow 'volume_create_manager' (a5d24fb6-9b33-4312-a71d-8c049f652802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be517c6-9e60-4180-8ea2-a1a03afdf307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be517c6-9e60-4180-8ea2-a1a03afdf307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-573762098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ac51ca-5f75-410e-b4b3-16a7d3492bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5f2a0d8ef4c739960556fcc2ee1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:50Z,use_quota=True,user_id='7bc0d9c63bcc4897948c959912ee7d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02efb143-15b4-4013-8161-6264b817b71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02efb143-15b4-4013-8161-6264b817b71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe8d07f-6101-4985-b9f0-cf2f7c076f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebe8d07f-6101-4985-b9f0-cf2f7c076f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8ac51ca-5f75-410e-b4b3-16a7d3492bbd', 'volume_name': 'volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e257336-dc1a-4622-9996-eae097dd03de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e257336-dc1a-4622-9996-eae097dd03de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fa8c96-d277-420c-8b1d-abdf7e022b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:50 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Volume f8ac51ca-5f75-410e-b4b3-16a7d3492bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd', 'volume_size': 1} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-573762098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8ac51ca-5f75-410e-b4b3-16a7d3492bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5f2a0d8ef4c739960556fcc2ee1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:38:50Z,use_quota=True,user_id='7bc0d9c63bcc4897948c959912ee7d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Creating volume f8ac51ca-5f75-410e-b4b3-16a7d3492bbd {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:38:50 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:38:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:50 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd 1073741824 Nov 01 09:38:50 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:51 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd 1073741824" returned: 0 in 0.548s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:51 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd Nov 01 09:38:51 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:51 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd" returned: 0 in 0.281s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77fa8c96-d277-420c-8b1d-abdf7e022b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4327fba8-8a7e-42c7-b604-e67f08a51321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:38:51 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Volume volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd (f8ac51ca-5f75-410e-b4b3-16a7d3492bbd): created successfully Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4327fba8-8a7e-42c7-b604-e67f08a51321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Flow 'volume_create_manager' (a5d24fb6-9b33-4312-a71d-8c049f652802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:38:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0d6dba38-eaf7-4471-af76-a8191bf3a6ce tempest-VolumesTransfersV357Test-766672593 None] Created volume successfully. Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d0fd2-7e29-4732-8e6e-ab9b937d5619]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:52 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:38:52 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:52 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.395s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca0c828-ece5-40d4-ac95-527d4d4a90a3]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:52 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:38:52 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:52 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Acquiring lock "cinder-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.468s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.7832d346-cd98-4072-b296-55f619487291gklste1z.img {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Lock "cinder-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:52 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.7832d346-cd98-4072-b296-55f619487291gklste1z.img Nov 01 09:38:52 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Acquiring lock "cinder-quobyte-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:38:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Lock "cinder-quobyte-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef2f574-c487-4b7c-9c16-7e240e5ad137]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:53 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd Nov 01 09:38:53 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:53 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:38:53 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:53 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd" returned: 0 in 0.657s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:53 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd Nov 01 09:38:53 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:53 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.487s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:38:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:38:54 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd" returned: 0 in 0.567s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Lock "cinder-quobyte-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd" released by "delete_volume" :: held 1.295s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Created reservations ['c8407aeb-4de3-4ee3-9f4e-3dabd2cc6929', '211d1fb4-295a-4c81-a34e-84c6f69dff64', 'eeb8e510-2d1b-430b-9202-a94a59ddf464', '6d894dbc-526a-4f39-90be-900a3d051e04'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:38:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:38:54 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:38:54 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:38:55 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Nov 01 09:38:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.464s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:38:55 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:38:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Deleted volume successfully. Nov 01 09:38:55 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-68276952-25f6-406a-aa36-18158e8f2b0b tempest-VolumesTransfersV357Test-393393907 None] Lock "cinder-f8ac51ca-5f75-410e-b4b3-16a7d3492bbd-delete_volume" released by "delete_volume" :: held 2.191s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:39:01 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.7832d346-cd98-4072-b296-55f619487291gklste1z.img" returned: 0 in 8.657s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:01 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d1f94d-861f-44d1-8702-21f8bd7a2570]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:01 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:39:01 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:02 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.551s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:02 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb, size 1024.00 MB, duration 8.66 sec, destination /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.7832d346-cd98-4072-b296-55f619487291gklste1z.img {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:39:02 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Converted 1024.00 MB image at 118.23 MB/s Nov 01 09:39:02 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] 7832d346-cd98-4072-b296-55f619487291 was raw, no need to convert to raw {{(pid=86594) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 01 09:39:04 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-6877ba7e-6619-4272-a672-03b154adef91 req-f46fb93e-b62f-43a6-bb74-8ba55859a774 tempest-AttachVolumeTestJSON-1801423078 None] Terminate volume connection completed successfully. Nov 01 09:39:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-6877ba7e-6619-4272-a672-03b154adef91 req-f46fb93e-b62f-43a6-bb74-8ba55859a774 tempest-AttachVolumeTestJSON-1801423078 None] Deleting attachment f0f3c280-d6ef-42f2-8b99-e637d1824001. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:39:14 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=23,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:39:14 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=24,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (58e8d2c0-9090-4ecf-bba9-9c9b6fab0d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42813cfa-6b59-4186-8faf-a39eaf68d5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42813cfa-6b59-4186-8faf-a39eaf68d5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-153483797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0010fef-ab26-4be1-927a-ef8843257609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf7af64841d4f59b051a5a4518cbe61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:39:22Z,use_quota=True,user_id='bdced33aac074eff8a498aab3dce1594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8261f82b-9ff1-486f-b9ab-ec34953240ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8261f82b-9ff1-486f-b9ab-ec34953240ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d8899f-63f4-4602-bb46-022bd37ddbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d8899f-63f4-4602-bb46-022bd37ddbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0010fef-ab26-4be1-927a-ef8843257609', 'volume_name': 'volume-d0010fef-ab26-4be1-927a-ef8843257609', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b34b3d9-4be6-4ad1-a677-c65318697cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b34b3d9-4be6-4ad1-a677-c65318697cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5953bc1f-03a4-4a8e-a1a3-8b916810bfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:22 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Volume d0010fef-ab26-4be1-927a-ef8843257609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0010fef-ab26-4be1-927a-ef8843257609', 'volume_size': 1} Nov 01 09:39:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=2 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Uploaded volume to glance image-id: 7832d346-cd98-4072-b296-55f619487291. {{(pid=86594) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.242s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-153483797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0010fef-ab26-4be1-927a-ef8843257609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf7af64841d4f59b051a5a4518cbe61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:39:22Z,use_quota=True,user_id='bdced33aac074eff8a498aab3dce1594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Creating volume d0010fef-ab26-4be1-927a-ef8843257609 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:39:32 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:39:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-82c59484-d437-497c-bba1-4338415619bd tempest-VolumesActionsTest-389134428 None] Copy volume to image completed successfully. Nov 01 09:39:33 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 1073741824 Nov 01 09:39:33 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:33 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 1073741824" returned: 0 in 0.741s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:33 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 Nov 01 09:39:33 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:34 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609" returned: 0 in 0.329s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5953bc1f-03a4-4a8e-a1a3-8b916810bfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0010fef-ab26-4be1-927a-ef8843257609', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba7df43-2299-4a25-a3c6-646537080968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:34 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Volume volume-d0010fef-ab26-4be1-927a-ef8843257609 (d0010fef-ab26-4be1-927a-ef8843257609): created successfully Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba7df43-2299-4a25-a3c6-646537080968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (58e8d2c0-9090-4ecf-bba9-9c9b6fab0d86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:39:34 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f010ffe7-9305-456d-988e-0192ba58ba0a tempest-VolumesSnapshotTestJSON-172522261 None] Created volume successfully. Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11ac7e0-7eef-429b-895e-7eee1f843f29]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:34 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:39:34 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:35 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.449s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ada4f7-0d9d-4b23-beb9-baa8a5159916]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:35 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:39:35 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:35 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.423s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:35 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img Nov 01 09:39:35 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img" returned: 0 in 7.614s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5664c592-7d2b-4ed6-b17b-b8e747359c2e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:43 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:39:43 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:43 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.541s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:39:43 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Converted 1024.00 MB image at 134.48 MB/s Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] 73e4916f-6d08-4fd7-aaf9-3dcf43dc50af was raw, converting to qcow2 {{(pid=86594) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d7e361-5612-43c5-9a13-7ba7c85d90c5]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:43 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img Nov 01 09:39:43 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:43 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img" returned: 0 in 0.321s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:44 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img Nov 01 09:39:44 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:44 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img" returned: 1 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img /opt/stack/data/cinder/conversion/vol_upload_u8ae3wwq {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:44 devstack sudo[94636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img /opt/stack/data/cinder/conversion/vol_upload_u8ae3wwq Nov 01 09:39:44 devstack sudo[94636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:39:44 devstack sudo[94636]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img /opt/stack/data/cinder/conversion/vol_upload_u8ae3wwq" returned: 0 in 0.267s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Image conversion details: src /opt/stack/data/cinder/conversion/7fa1bb86-e0e5-446c-99db-d675fb3de8cb.temp_image.73e4916f-6d08-4fd7-aaf9-3dcf43dc50afbb6odw75.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u8ae3wwq {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:39:44 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e738f4da-b4e5-46c8-a867-30226d6efbe3]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8ae3wwq {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:44 devstack sudo[94642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8ae3wwq Nov 01 09:39:44 devstack sudo[94642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:44 devstack sudo[94642]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8ae3wwq" returned: 0 in 0.341s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.989s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Uploaded volume to glance image-id: 73e4916f-6d08-4fd7-aaf9-3dcf43dc50af. {{(pid=86594) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 09:39:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.274s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Creating offline snapshot 8efe5e0a-50a1-4663-a1c1-af2840c77d7e of volume d0010fef-ab26-4be1-927a-ef8843257609 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:39:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bb2e5fd7-a674-4d98-8281-4b0d27d00d8e tempest-VolumesActionsTest-389134428 None] Copy volume to image completed successfully. Nov 01 09:39:46 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cd97e7-a481-428e-b98e-14162494753e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:46 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 Nov 01 09:39:46 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:47 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609" returned: 0 in 0.405s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:47 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e 1G Nov 01 09:39:47 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:47 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e 1G" returned: 0 in 0.515s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0010fef-ab26-4be1-927a-ef8843257609 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:47 devstack sudo[94659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0010fef-ab26-4be1-927a-ef8843257609 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e Nov 01 09:39:47 devstack sudo[94659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:47 devstack sudo[94659]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0010fef-ab26-4be1-927a-ef8843257609 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e" returned: 0 in 0.361s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:47 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e is being set with open permissions: ugo+rw Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Acquiring lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:39:47 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e Nov 01 09:39:47 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:39:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Acquiring lock "cinder-quobyte-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Lock "cinder-quobyte-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da975a-09f6-4f37-b406-35675a9d1130]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:48 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:39:48 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:48 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e" returned: 0 in 0.292s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:48 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.info Nov 01 09:39:48 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:48 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.info" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:48 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.info is being set with open permissions: ugo+rw Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:48 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.467s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:48 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.info Nov 01 09:39:48 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:48 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb Nov 01 09:39:48 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:48 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.info" returned: 0 in 0.277s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:48 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" returned: 0 in 0.297s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Lock "cinder-quobyte-7fa1bb86-e0e5-446c-99db-d675fb3de8cb" released by "delete_volume" :: held 0.824s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:39:48 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d7ee4a67-d932-4613-a3b0-a849a3e6fb96 tempest-VolumesSnapshotTestJSON-172522261 None] Create snapshot completed successfully Nov 01 09:39:48 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Created reservations ['e7eee1d5-9897-4503-800b-9c7533e3b45f', '862824c1-83ca-4438-9e25-d429c2b2b07b', '61f83593-1bfb-4a47-8c14-b16fdbc580ff', 'b345a187-b844-4f43-9978-16ec2038fcfc'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:49 devstack sudo[94692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:39:49 devstack sudo[94692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-8efe5e0a-50a1-4663-a1c1-af2840c77d7e-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-8efe5e0a-50a1-4663-a1c1-af2840c77d7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-d0010fef-ab26-4be1-927a-ef8843257609" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:39:49 devstack sudo[94692]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.387s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:39:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Deleted volume successfully. Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-d0010fef-ab26-4be1-927a-ef8843257609" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-8efe5e0a-50a1-4663-a1c1-af2840c77d7e" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-15e5ca5c-6bf1-4e3d-b135-4378d6e3b07f tempest-VolumesActionsTest-389134428 None] Lock "cinder-7fa1bb86-e0e5-446c-99db-d675fb3de8cb-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-8efe5e0a-50a1-4663-a1c1-af2840c77d7e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Deleting offline snapshot 8efe5e0a-50a1-4663-a1c1-af2840c77d7e of volume d0010fef-ab26-4be1-927a-ef8843257609 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] snapshot_file for this snap is: volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e7215-b07c-4fa3-8489-d3efa0bb8ea0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:49 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e Nov 01 09:39:49 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:50 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e" returned: 0 in 0.618s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0010fef-ab26-4be1-927a-ef8843257609(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff00cb3-e598-4ac4-8913-c054f874efe5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Flow 'volume_create_manager' (675fc822-90be-4c5b-8c0c-b37d6370ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98ccc8f-70d4-43ab-9f5d-e3449f863225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:50 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 Nov 01 09:39:50 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98ccc8f-70d4-43ab-9f5d-e3449f863225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1928755657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3ff963-6d2d-4e9c-a31f-692a0192ceff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9517d487968645c290be74236dd9569e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:39:50Z,use_quota=True,user_id='fbcbfe2f5be540aeb815b3b48753b68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0f2f37-50a9-48f2-98d5-3ab7f7786869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc0f2f37-50a9-48f2-98d5-3ab7f7786869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7652ab36-cf47-4626-9738-4dc1297a98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7652ab36-cf47-4626-9738-4dc1297a98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec3ff963-6d2d-4e9c-a31f-692a0192ceff', 'volume_name': 'volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9a3229-0251-4341-a579-55931ea28288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d9a3229-0251-4341-a579-55931ea28288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb15082-e306-4957-a01d-4502ca18ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:50 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Volume ec3ff963-6d2d-4e9c-a31f-692a0192ceff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff', 'volume_size': 1} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1928755657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec3ff963-6d2d-4e9c-a31f-692a0192ceff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9517d487968645c290be74236dd9569e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:39:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:39:50Z,use_quota=True,user_id='fbcbfe2f5be540aeb815b3b48753b68e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Creating volume ec3ff963-6d2d-4e9c-a31f-692a0192ceff {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:39:50 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:50 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff 1073741824 Nov 01 09:39:50 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:50 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609" returned: 0 in 0.556s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:50 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e Nov 01 09:39:50 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:51 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff 1073741824" returned: 0 in 0.644s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:51 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff Nov 01 09:39:51 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:51 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e" returned: 0 in 0.517s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:51 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e Nov 01 09:39:51 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:51 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff" returned: 0 in 0.383s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb15082-e306-4957-a01d-4502ca18ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e48e7a0-aedc-405a-9b53-82e59ee974ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:51 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Volume volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff (ec3ff963-6d2d-4e9c-a31f-692a0192ceff): created successfully Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e48e7a0-aedc-405a-9b53-82e59ee974ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:51 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Flow 'volume_create_manager' (675fc822-90be-4c5b-8c0c-b37d6370ab98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609.8efe5e0a-50a1-4663-a1c1-af2840c77d7e" returned: 0 in 0.295s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d1462e80-eee2-44f3-ba85-740f54fe46ea tempest-AttachVolumeShelveTestJSON-1945982561 None] Created volume successfully. Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-8efe5e0a-50a1-4663-a1c1-af2840c77d7e" released by "_delete_snapshot" :: held 2.197s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-d0010fef-ab26-4be1-927a-ef8843257609" released by "delete_snapshot" :: held 2.241s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Created reservations ['66fe67e1-6f9d-4dfe-b6cb-ab059276932f', '4ca1e27e-cc6b-43fe-be0a-af265028cd44', '29d47e0a-73ef-46b1-b756-8296216a9b9d', '8863a2c5-6c45-4255-902c-65c2e890b537'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:39:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Delete snapshot completed successfully. Nov 01 09:39:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31ba6664-f81c-4c98-9c36-edb5805483a1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-8efe5e0a-50a1-4663-a1c1-af2840c77d7e-delete_snapshot" released by "delete_snapshot" :: held 2.490s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:53 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:39:53 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (9a99a7ac-2344-40b2-9c88-154944d03eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cada89e5-a895-4ce5-b7b6-9b934ba0ff2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cada89e5-a895-4ce5-b7b6-9b934ba0ff2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-818340900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97b9dc9-8db1-4b43-a837-d318e8a83be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf7af64841d4f59b051a5a4518cbe61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:39:53Z,use_quota=True,user_id='bdced33aac074eff8a498aab3dce1594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93009e9-8fae-4a62-a6fc-d36f1499ed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f93009e9-8fae-4a62-a6fc-d36f1499ed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd57a785-bcf3-48f7-96e0-2a16e184acb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd57a785-bcf3-48f7-96e0-2a16e184acb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97b9dc9-8db1-4b43-a837-d318e8a83be7', 'volume_name': 'volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce7eb2f-f457-4176-9ccf-922d98993b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce7eb2f-f457-4176-9ccf-922d98993b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06274cb2-7a2d-460a-bdf5-8f26a08d3639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:53 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Volume c97b9dc9-8db1-4b43-a837-d318e8a83be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7', 'volume_size': 1} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-818340900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97b9dc9-8db1-4b43-a837-d318e8a83be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf7af64841d4f59b051a5a4518cbe61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:39:53Z,use_quota=True,user_id='bdced33aac074eff8a498aab3dce1594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Creating volume c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:39:53 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:53 devstack sudo[94795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 1073741824 Nov 01 09:39:53 devstack sudo[94795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:53 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.584s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:39:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:39:54 devstack sudo[94795]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 1073741824" returned: 0 in 1.034s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:54 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 Nov 01 09:39:54 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:55 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7" returned: 0 in 0.375s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:39:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06274cb2-7a2d-460a-bdf5-8f26a08d3639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aed8b11-9d00-4bd1-b974-4e9dc3e61b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:39:55 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Volume volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 (c97b9dc9-8db1-4b43-a837-d318e8a83be7): created successfully Nov 01 09:39:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aed8b11-9d00-4bd1-b974-4e9dc3e61b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:39:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (9a99a7ac-2344-40b2-9c88-154944d03eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:39:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-963decd6-bbf3-4553-a91b-8eada06e8959 tempest-VolumesSnapshotTestJSON-172522261 None] Created volume successfully. Nov 01 09:39:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:39:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:39:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Creating offline snapshot faf4c35b-7a26-42f5-86e9-7e259a85bd96 of volume c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:39:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d638cc-3fa3-4c6c-a984-a50995492180]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:39:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:56 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 Nov 01 09:39:56 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:56 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7" returned: 0 in 0.534s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:56 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 1G Nov 01 09:39:56 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:57 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 1G" returned: 0 in 0.705s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:57 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 Nov 01 09:39:57 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:57 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96" returned: 0 in 0.556s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:57 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 is being set with open permissions: ugo+rw Nov 01 09:39:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:58 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 Nov 01 09:39:58 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:58 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96" returned: 0 in 0.334s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:58 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.info Nov 01 09:39:58 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:58 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.info" returned: 0 in 0.606s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:58 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.info is being set with open permissions: ugo+rw Nov 01 09:39:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:39:59 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.info Nov 01 09:39:59 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:39:59 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Nov 01 09:39:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.info" returned: 0 in 0.544s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:39:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.475s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:39:59 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c86124cb-7da8-461e-bec0-dc9a16391c6b tempest-VolumesSnapshotTestJSON-172522261 None] Create snapshot completed successfully Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (3ab3ca5f-0ac2-4aeb-a067-42644a029041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5070f107-2aa7-4bd7-9eda-022ec10c88f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5070f107-2aa7-4bd7-9eda-022ec10c88f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1946572641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06d1becc-24c3-496d-af18-b6b475bea0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf7af64841d4f59b051a5a4518cbe61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=faf4c35b-7a26-42f5-86e9-7e259a85bd96,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:02Z,use_quota=True,user_id='bdced33aac074eff8a498aab3dce1594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7803dc9d-6e1c-481d-a371-0245fe43bd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7803dc9d-6e1c-481d-a371-0245fe43bd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ecc02e-bf98-436c-a369-a65a883635cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18ecc02e-bf98-436c-a369-a65a883635cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '06d1becc-24c3-496d-af18-b6b475bea0b8', 'volume_name': 'volume-06d1becc-24c3-496d-af18-b6b475bea0b8', 'volume_size': 2, 'snapshot_id': 'faf4c35b-7a26-42f5-86e9-7e259a85bd96'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f4ee01-7d86-44c6-b281-1690213ac877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f4ee01-7d86-44c6-b281-1690213ac877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1cc99fe-7fb6-417a-9b3c-9a355595f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Volume 06d1becc-24c3-496d-af18-b6b475bea0b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-06d1becc-24c3-496d-af18-b6b475bea0b8', 'volume_size': 2, 'snapshot_id': 'faf4c35b-7a26-42f5-86e9-7e259a85bd96'} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Flow 'volume_create_manager' (f4370e95-324a-49a2-995b-cd412062a4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c706ae9a-9d15-4a84-ba41-aa2bfdc40ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-faf4c35b-7a26-42f5-86e9-7e259a85bd96-06d1becc-24c3-496d-af18-b6b475bea0b8" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c706ae9a-9d15-4a84-ba41-aa2bfdc40ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2127719464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b663028e-2753-4d81-be38-a4f4f1538463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbe7abbc54645c993ec1e3b97b65d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:02Z,use_quota=True,user_id='9c10b140dd804520af119e65ba9d6f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d02393-70db-4d83-8760-3b44dd96fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d02393-70db-4d83-8760-3b44dd96fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c84d2c1-e314-4b6d-8c75-1743c6f0ada3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c84d2c1-e314-4b6d-8c75-1743c6f0ada3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b663028e-2753-4d81-be38-a4f4f1538463', 'volume_name': 'volume-b663028e-2753-4d81-be38-a4f4f1538463', 'volume_size': 2}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df0893f-609c-410a-af8b-d53d3888638c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df0893f-609c-410a-af8b-d53d3888638c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fbe870-7413-425a-bb9a-fe150c024abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:01 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Volume b663028e-2753-4d81-be38-a4f4f1538463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b663028e-2753-4d81-be38-a4f4f1538463', 'volume_size': 2} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-faf4c35b-7a26-42f5-86e9-7e259a85bd96-06d1becc-24c3-496d-af18-b6b475bea0b8" acquired by "_create_volume_from_snapshot" :: waited 0.062s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Creating volume 06d1becc-24c3-496d-af18-b6b475bea0b8 from snapshot faf4c35b-7a26-42f5-86e9-7e259a85bd96 {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:40:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-06d1becc-24c3-496d-af18-b6b475bea0b8" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-06d1becc-24c3-496d-af18-b6b475bea0b8" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] snapshot: faf4c35b-7a26-42f5-86e9-7e259a85bd96, volume: 06d1becc-24c3-496d-af18-b6b475bea0b8, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e53e3-0be4-48b5-a97e-8c1f85adb4cb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:02 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 Nov 01 09:40:02 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:02 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96" returned: 0 in 0.472s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df371fb-b4a9-49f5-a5c1-159ef7e99775]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:02 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 Nov 01 09:40:02 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:03 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7" returned: 0 in 0.627s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:40:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:40:03 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:40:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:03 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 Nov 01 09:40:03 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-0c38b09c-0452-4b29-8410-cb5ba88797a5 req-f8fece4d-7985-4e6d-bef6-46f56bc6b8b6 tempest-AttachVolumeShelveTestJSON-1945982561 None] No connector for attachment 5bee34c3-7149-4239-b4aa-0807981b9b12; skipping storage backend terminate_connection call. {{(pid=86594) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 01 09:40:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-0c38b09c-0452-4b29-8410-cb5ba88797a5 req-f8fece4d-7985-4e6d-bef6-46f56bc6b8b6 tempest-AttachVolumeShelveTestJSON-1945982561 None] Deleting attachment 5bee34c3-7149-4239-b4aa-0807981b9b12. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:40:11 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8" returned: 0 in 8.573s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:11 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7, size 1024.00 MB, duration 8.57 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:40:11 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Converted 1024.00 MB image at 119.43 MB/s Nov 01 09:40:11 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 is being set with open permissions: ugo+rw Nov 01 09:40:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:11 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 Nov 01 09:40:11 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:12 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8" returned: 0 in 0.240s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-06d1becc-24c3-496d-af18-b6b475bea0b8" released by "_copy_volume_from_snapshot" :: held 10.022s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-faf4c35b-7a26-42f5-86e9-7e259a85bd96-06d1becc-24c3-496d-af18-b6b475bea0b8" released by "_create_volume_from_snapshot" :: held 10.093s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.156s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.105s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2127719464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b663028e-2753-4d81-be38-a4f4f1538463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fbe7abbc54645c993ec1e3b97b65d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:02Z,use_quota=True,user_id='9c10b140dd804520af119e65ba9d6f5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Creating volume b663028e-2753-4d81-be38-a4f4f1538463 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:40:12 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 2147483648 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:12 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 2147483648 Nov 01 09:40:12 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1cc99fe-7fb6-417a-9b3c-9a355595f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06d1becc-24c3-496d-af18-b6b475bea0b8', 'volume_size': 2, 'snapshot_id': 'faf4c35b-7a26-42f5-86e9-7e259a85bd96'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512ff67f-24b2-4aa7-8e99-a2aa27adc1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Volume volume-06d1becc-24c3-496d-af18-b6b475bea0b8 (06d1becc-24c3-496d-af18-b6b475bea0b8): created successfully Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512ff67f-24b2-4aa7-8e99-a2aa27adc1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (3ab3ca5f-0ac2-4aeb-a067-42644a029041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:12 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-79149960-596e-4c0f-b63a-51419e3eda36 tempest-VolumesSnapshotTestJSON-172522261 None] Created volume successfully. Nov 01 09:40:12 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 2147483648" returned: 0 in 0.592s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:12 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 Nov 01 09:40:12 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-06d1becc-24c3-496d-af18-b6b475bea0b8-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-06d1becc-24c3-496d-af18-b6b475bea0b8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-06d1becc-24c3-496d-af18-b6b475bea0b8" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-06d1becc-24c3-496d-af18-b6b475bea0b8" acquired by "delete_volume" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b48a2a-23ee-4dd2-9690-6bd6c7846d43]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:13 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463" returned: 0 in 0.399s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0fbe870-7413-425a-bb9a-fe150c024abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b663028e-2753-4d81-be38-a4f4f1538463', 'volume_size': 2}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc1390d-2f59-4c93-8ef2-b69d8095541d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Volume volume-b663028e-2753-4d81-be38-a4f4f1538463 (b663028e-2753-4d81-be38-a4f4f1538463): created successfully Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cc1390d-2f59-4c93-8ef2-b69d8095541d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Flow 'volume_create_manager' (f4370e95-324a-49a2-995b-cd412062a4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:13 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-39f524aa-58da-4d22-b7fd-b1eaa74dcec4 tempest-VolumesCloneNegativeTest-1081846935 None] Created volume successfully. Nov 01 09:40:13 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 Nov 01 09:40:13 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:13 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8" returned: 0 in 0.458s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:13 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8 Nov 01 09:40:13 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:13 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-06d1becc-24c3-496d-af18-b6b475bea0b8" returned: 0 in 0.264s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-06d1becc-24c3-496d-af18-b6b475bea0b8" released by "delete_volume" :: held 0.790s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Created reservations ['a7dff455-c54e-4ecf-9919-bf288ba55de7', '83513fb7-1169-4fb9-ac5f-0d33ba83e956', '111d1411-a77c-4041-af72-efef87266312', '58684a2b-c753-4109-96e3-7f8512ec484b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:14 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:14 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Acquiring lock "cinder-b663028e-2753-4d81-be38-a4f4f1538463-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "cinder-b663028e-2753-4d81-be38-a4f4f1538463-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-faf4c35b-7a26-42f5-86e9-7e259a85bd96-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-faf4c35b-7a26-42f5-86e9-7e259a85bd96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-c97b9dc9-8db1-4b43-a837-d318e8a83be7" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-c97b9dc9-8db1-4b43-a837-d318e8a83be7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-faf4c35b-7a26-42f5-86e9-7e259a85bd96" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Acquiring lock "cinder-quobyte-b663028e-2753-4d81-be38-a4f4f1538463" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-faf4c35b-7a26-42f5-86e9-7e259a85bd96" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Deleting offline snapshot faf4c35b-7a26-42f5-86e9-7e259a85bd96 of volume c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:40:14 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] snapshot_file for this snap is: volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "cinder-quobyte-b663028e-2753-4d81-be38-a4f4f1538463" acquired by "delete_volume" :: waited 0.064s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[05712178-ec85-429e-8c4d-c91d4c985068]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.489s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Deleted volume successfully. Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad784c77-4ab1-4f06-aa61-a215a0b757ff]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4572a893-8358-49ad-948e-9cb56d2e18f5 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-06d1becc-24c3-496d-af18-b6b475bea0b8-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:14 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 Nov 01 09:40:14 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:14 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 Nov 01 09:40:14 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:14 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96" returned: 0 in 0.515s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:40:15 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463" returned: 0 in 0.515s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[806e78ed-2808-4fea-b468-b0ce1238e20d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:15 devstack sudo[95005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463 Nov 01 09:40:15 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:15 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 Nov 01 09:40:15 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:15 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b663028e-2753-4d81-be38-a4f4f1538463" returned: 0 in 0.280s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "cinder-quobyte-b663028e-2753-4d81-be38-a4f4f1538463" released by "delete_volume" :: held 0.902s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Created reservations ['2a24e8ca-4e3d-43a4-806a-dd469ed88f9e', 'ad42541b-2719-4043-817b-53ccec919f88', '869d8335-34ed-4999-8f0f-521210b48c04', '4c1e3236-4456-4925-a036-6bc275122119'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:15 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:15 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:15 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7" returned: 0 in 0.656s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:15 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 Nov 01 09:40:15 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:15 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.303s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Deleted volume successfully. Nov 01 09:40:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0238f84b-01de-4995-9358-5438e6471300 tempest-VolumesCloneNegativeTest-1081846935 None] Lock "cinder-b663028e-2753-4d81-be38-a4f4f1538463-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:16 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96" returned: 0 in 0.508s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:16 devstack sudo[95039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96 Nov 01 09:40:16 devstack sudo[95039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:16 devstack sudo[95039]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7.faf4c35b-7a26-42f5-86e9-7e259a85bd96" returned: 0 in 0.265s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-faf4c35b-7a26-42f5-86e9-7e259a85bd96" released by "_delete_snapshot" :: held 2.135s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-c97b9dc9-8db1-4b43-a837-d318e8a83be7" released by "delete_snapshot" :: held 2.184s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:16 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Created reservations ['eecd5619-105b-485e-a0ee-ec7410d30639', '89838c1b-11d7-4a1f-aaf0-1f5677d7e034', 'ea9f5724-3c78-41dc-9d8f-7d5ce33807dd', 'be311b41-4d7f-4a39-9fa1-26c78f38b21b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Delete snapshot completed successfully. Nov 01 09:40:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8e6eb765-821d-46e0-b53e-c9e065be2c6a tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-faf4c35b-7a26-42f5-86e9-7e259a85bd96-delete_snapshot" released by "delete_snapshot" :: held 2.430s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-c97b9dc9-8db1-4b43-a837-d318e8a83be7-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-c97b9dc9-8db1-4b43-a837-d318e8a83be7-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-c97b9dc9-8db1-4b43-a837-d318e8a83be7" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-c97b9dc9-8db1-4b43-a837-d318e8a83be7" acquired by "delete_volume" :: waited 0.040s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf77abf-ec7d-4f5e-8e49-8f6ab7c7896a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:18 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 Nov 01 09:40:18 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:18 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7" returned: 0 in 0.551s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:18 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7 Nov 01 09:40:18 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:18 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c97b9dc9-8db1-4b43-a837-d318e8a83be7" returned: 0 in 0.536s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-c97b9dc9-8db1-4b43-a837-d318e8a83be7" released by "delete_volume" :: held 1.193s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Created reservations ['c7f97e69-e1cf-4b08-bc7a-7ef3696a43a3', 'c647b62f-0693-4a31-b455-7d240635682e', '4e3bcfe3-c106-4578-abf4-9b055d21f9e7', '162545fc-d5a4-41bf-89c0-f26318b90f44'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:19 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:19 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:19 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.361s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Deleted volume successfully. Nov 01 09:40:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bb28ea76-28e0-4238-8a64-2c7c7ffa97c1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-c97b9dc9-8db1-4b43-a837-d318e8a83be7-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Flow 'volume_create_manager' (080e4331-5205-4d01-84a7-f46080b6f0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46419cc-6ffb-4b5a-be87-d81ec2f3a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a46419cc-6ffb-4b5a-be87-d81ec2f3a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751844754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd5b98e-3efa-4077-b879-07b66ed465da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee1cb0a3efb410db4609f601416fea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:21Z,use_quota=True,user_id='d5fdbfcae9e0476081038f3e372cde6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30192dbf-6f21-441e-bb85-6f1e1b8a8d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30192dbf-6f21-441e-bb85-6f1e1b8a8d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6748a19c-2479-4128-9788-a09ac8510e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6748a19c-2479-4128-9788-a09ac8510e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd5b98e-3efa-4077-b879-07b66ed465da', 'volume_name': 'volume-7cd5b98e-3efa-4077-b879-07b66ed465da', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a165926d-b9f6-41bd-9331-25ad7ff021d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a165926d-b9f6-41bd-9331-25ad7ff021d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd5ca4a-4629-4fbb-99c2-0785e58d9e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:20 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Volume 7cd5b98e-3efa-4077-b879-07b66ed465da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd5b98e-3efa-4077-b879-07b66ed465da', 'volume_size': 1} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-751844754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd5b98e-3efa-4077-b879-07b66ed465da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee1cb0a3efb410db4609f601416fea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:21Z,use_quota=True,user_id='d5fdbfcae9e0476081038f3e372cde6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Creating volume 7cd5b98e-3efa-4077-b879-07b66ed465da {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:40:20 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:20 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da 1073741824 Nov 01 09:40:20 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:40:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (2211f8a0-a6f9-4da4-b0df-7584190409b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26534362-e7bb-4083-b852-15e13f8561c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26534362-e7bb-4083-b852-15e13f8561c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-854495684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2c5547-e35a-4868-99ff-14fa3eb837d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf7af64841d4f59b051a5a4518cbe61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:21Z,use_quota=True,user_id='bdced33aac074eff8a498aab3dce1594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137755e6-55fc-4d2d-ba24-0c90727cadb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137755e6-55fc-4d2d-ba24-0c90727cadb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e848d461-152b-4344-aee3-397cf7fa2997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e848d461-152b-4344-aee3-397cf7fa2997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2c5547-e35a-4868-99ff-14fa3eb837d9', 'volume_name': 'volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd433cb-0cca-4790-a013-4e513bc0a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd433cb-0cca-4790-a013-4e513bc0a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ac0d17-92fb-45bc-b5f8-cbf3ddbcbb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:21 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Volume cc2c5547-e35a-4868-99ff-14fa3eb837d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9', 'volume_size': 1} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:21 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da 1073741824" returned: 0 in 0.601s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:21 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da Nov 01 09:40:21 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:21 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da" returned: 0 in 0.290s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-854495684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2c5547-e35a-4868-99ff-14fa3eb837d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf7af64841d4f59b051a5a4518cbe61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:21Z,use_quota=True,user_id='bdced33aac074eff8a498aab3dce1594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Creating volume cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:40:21 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd5ca4a-4629-4fbb-99c2-0785e58d9e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd5b98e-3efa-4077-b879-07b66ed465da', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:21 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 1073741824 Nov 01 09:40:21 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba079571-d8d9-421f-95d0-6f58f151b4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:21 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Volume volume-7cd5b98e-3efa-4077-b879-07b66ed465da (7cd5b98e-3efa-4077-b879-07b66ed465da): created successfully Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba079571-d8d9-421f-95d0-6f58f151b4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Flow 'volume_create_manager' (080e4331-5205-4d01-84a7-f46080b6f0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5e25b589-7e6c-47be-a132-ac4251d1d380 tempest-AttachVolumeTestJSON-1801423078 None] Created volume successfully. Nov 01 09:40:22 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 1073741824" returned: 0 in 0.554s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:22 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 Nov 01 09:40:22 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Flow 'volume_create_manager' (39632671-2e26-4218-8f56-33a1eb52349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5799b457-7225-461f-9025-4861316f5d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5799b457-7225-461f-9025-4861316f5d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1624702907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05977e9e-ca6d-4894-b23a-8f035e26fd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43045a65ad6d4ffea2d0423c38108248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:22Z,use_quota=True,user_id='cd4f7b56d11a46889092d279002af335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6722ef5e-3cce-4c4a-b88f-d4b2de446fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6722ef5e-3cce-4c4a-b88f-d4b2de446fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f241d1-088f-445b-93e8-57b9eaf60548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f241d1-088f-445b-93e8-57b9eaf60548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05977e9e-ca6d-4894-b23a-8f035e26fd66', 'volume_name': 'volume-05977e9e-ca6d-4894-b23a-8f035e26fd66', 'volume_size': 2}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae89400-e7ec-4d8d-9be7-e9b1acfdd2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:22 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae89400-e7ec-4d8d-9be7-e9b1acfdd2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36c1c41-4dc2-4832-a0c7-24174455e492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:22 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Volume 05977e9e-ca6d-4894-b23a-8f035e26fd66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05977e9e-ca6d-4894-b23a-8f035e26fd66', 'volume_size': 2} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9" returned: 0 in 0.304s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1624702907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05977e9e-ca6d-4894-b23a-8f035e26fd66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43045a65ad6d4ffea2d0423c38108248',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:22Z,use_quota=True,user_id='cd4f7b56d11a46889092d279002af335',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Creating volume 05977e9e-ca6d-4894-b23a-8f035e26fd66 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:40:22 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 2147483648 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ac0d17-92fb-45bc-b5f8-cbf3ddbcbb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b3fc70-0749-4e20-974c-2923d9c16763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:22 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 2147483648 Nov 01 09:40:22 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:22 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Volume volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 (cc2c5547-e35a-4868-99ff-14fa3eb837d9): created successfully Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b3fc70-0749-4e20-974c-2923d9c16763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (2211f8a0-a6f9-4da4-b0df-7584190409b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f4af0dac-dedb-487e-bf7c-fd14e764603b tempest-VolumesSnapshotTestJSON-172522261 None] Created volume successfully. Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:23 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 2147483648" returned: 0 in 0.701s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:23 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 Nov 01 09:40:23 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1564f35f-1b7d-46df-b817-a4284cc726a4 req-dd3a1590-2de7-4670-bf8e-d05b337a0211 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:23 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66" returned: 0 in 0.280s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.542s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Creating offline snapshot 4df4189a-83f3-4579-9813-fc7aa8aa5976 of volume cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b36c1c41-4dc2-4832-a0c7-24174455e492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05977e9e-ca6d-4894-b23a-8f035e26fd66', 'volume_size': 2}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8482cf-8d10-401f-a4df-d2fb523c191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f12a6-0b5e-4ff9-8eb7-fa01f65645b6]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Volume volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 (05977e9e-ca6d-4894-b23a-8f035e26fd66): created successfully Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8482cf-8d10-401f-a4df-d2fb523c191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Flow 'volume_create_manager' (39632671-2e26-4218-8f56-33a1eb52349b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:23 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-277754d5-1cbc-4d72-b485-7b513de967b5 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Created volume successfully. Nov 01 09:40:23 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 Nov 01 09:40:23 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:24 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9" returned: 0 in 0.415s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:24 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 1G Nov 01 09:40:24 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:24 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 1G" returned: 0 in 0.426s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:24 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 Nov 01 09:40:24 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:24 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976" returned: 0 in 0.329s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:24 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 is being set with open permissions: ugo+rw Nov 01 09:40:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:24 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 Nov 01 09:40:24 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:25 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:25 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.info Nov 01 09:40:25 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:25 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.info" returned: 0 in 0.258s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:25 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.info is being set with open permissions: ugo+rw Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:25 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.info Nov 01 09:40:25 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:25 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.info" returned: 0 in 0.243s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1564f35f-1b7d-46df-b817-a4284cc726a4 req-dd3a1590-2de7-4670-bf8e-d05b337a0211 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.105s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1564f35f-1b7d-46df-b817-a4284cc726a4 req-dd3a1590-2de7-4670-bf8e-d05b337a0211 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.916s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1d2163b8-1d5c-414f-9519-f0334218ddde tempest-VolumesSnapshotTestJSON-172522261 None] Create snapshot completed successfully Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-1564f35f-1b7d-46df-b817-a4284cc726a4 req-dd3a1590-2de7-4670-bf8e-d05b337a0211 tempest-AttachVolumeTestJSON-1801423078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-7cd5b98e-3efa-4077-b879-07b66ed465da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '558023d0-9dda-4ef5-85e5-9a4472797b72', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Creating offline snapshot e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 of volume 05977e9e-ca6d-4894-b23a-8f035e26fd66 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd03d3f-a139-474d-abb5-f7e7e5143250]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-1564f35f-1b7d-46df-b817-a4284cc726a4 req-dd3a1590-2de7-4670-bf8e-d05b337a0211 tempest-AttachVolumeTestJSON-1801423078 None] attachment_update completed successfully. Nov 01 09:40:26 devstack sudo[95191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 Nov 01 09:40:26 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:26 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66" returned: 0 in 0.475s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 2G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:26 devstack sudo[95613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 2G Nov 01 09:40:26 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:27 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 2G" returned: 0 in 0.676s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:40:27 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 Nov 01 09:40:27 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (2ace1c3d-8591-4460-9a5c-b2df6f5ce2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5df99b-1fb7-4253-a606-ef81d051de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5df99b-1fb7-4253-a606-ef81d051de3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1234396782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364bcad2-7b90-42c4-a4d1-60dc68556bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf7af64841d4f59b051a5a4518cbe61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4df4189a-83f3-4579-9813-fc7aa8aa5976,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:27Z,use_quota=True,user_id='bdced33aac074eff8a498aab3dce1594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887ebe96-c20b-4b12-b0cc-af59a1512a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (887ebe96-c20b-4b12-b0cc-af59a1512a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30de056-105a-42a2-a8c0-78e08f91a52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30de056-105a-42a2-a8c0-78e08f91a52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '364bcad2-7b90-42c4-a4d1-60dc68556bf9', 'volume_name': 'volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9', 'volume_size': 1, 'snapshot_id': '4df4189a-83f3-4579-9813-fc7aa8aa5976'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d4a557-cb72-43fc-b600-932444fe3b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d4a557-cb72-43fc-b600-932444fe3b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44575302-b0e7-404f-b68a-a2ce1ada9508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:27 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Volume 364bcad2-7b90-42c4-a4d1-60dc68556bf9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9', 'volume_size': 1, 'snapshot_id': '4df4189a-83f3-4579-9813-fc7aa8aa5976'} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:27 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9" returned: 0 in 0.316s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:27 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 is being set with open permissions: ugo+rw Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:27 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 Nov 01 09:40:27 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:27 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9" returned: 0 in 0.241s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:27 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.info Nov 01 09:40:27 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:27 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.info" returned: 0 in 0.260s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:27 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.info is being set with open permissions: ugo+rw Nov 01 09:40:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:27 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.info Nov 01 09:40:27 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:28 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.info" returned: 0 in 0.286s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.021s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-4df4189a-83f3-4579-9813-fc7aa8aa5976-364bcad2-7b90-42c4-a4d1-60dc68556bf9" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-4df4189a-83f3-4579-9813-fc7aa8aa5976-364bcad2-7b90-42c4-a4d1-60dc68556bf9" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Creating volume 364bcad2-7b90-42c4-a4d1-60dc68556bf9 from snapshot 4df4189a-83f3-4579-9813-fc7aa8aa5976 {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-364bcad2-7b90-42c4-a4d1-60dc68556bf9" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8373bb15-cf3b-4adc-9f84-c10f01967af2 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Create snapshot completed successfully Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-364bcad2-7b90-42c4-a4d1-60dc68556bf9" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] snapshot: 4df4189a-83f3-4579-9813-fc7aa8aa5976, volume: 364bcad2-7b90-42c4-a4d1-60dc68556bf9, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aac89cd-3b79-4e5f-927b-6ff687d26f4d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:28 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 Nov 01 09:40:28 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Flow 'volume_create_manager' (4e92f4bd-7595-4949-ad33-7f67adb8d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de52483-0e6c-47af-862f-9547ab3f952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de52483-0e6c-47af-862f-9547ab3f952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-30718701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e067bdf-0dd4-403b-af9f-d89df20dcab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee1cb0a3efb410db4609f601416fea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:29Z,use_quota=True,user_id='d5fdbfcae9e0476081038f3e372cde6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b23816d-8e7f-4252-9e3e-fb82a626b523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b23816d-8e7f-4252-9e3e-fb82a626b523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff311f83-fd5f-4f65-aa80-edc95b6069d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff311f83-fd5f-4f65-aa80-edc95b6069d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e067bdf-0dd4-403b-af9f-d89df20dcab6', 'volume_name': 'volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fce6cc-8fdd-44d3-8e23-4fda01059959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fce6cc-8fdd-44d3-8e23-4fda01059959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17971e51-9895-4ce0-8b9e-37322ab0ddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Volume 0e067bdf-0dd4-403b-af9f-d89df20dcab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6', 'volume_size': 1} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:28 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976" returned: 0 in 0.409s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[291e33b7-446a-4880-af2a-dfafdf6550c8]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:28 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 Nov 01 09:40:28 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:29 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9" returned: 0 in 0.396s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:29 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 Nov 01 09:40:29 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "cinder-e32257d5-e969-4dd5-9b24-0a5ff18ed4c9-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-e32257d5-e969-4dd5-9b24-0a5ff18ed4c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "cinder-quobyte-05977e9e-ca6d-4894-b23a-8f035e26fd66" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-quobyte-05977e9e-ca6d-4894-b23a-8f035e26fd66" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "cinder-quobyte-e32257d5-e969-4dd5-9b24-0a5ff18ed4c9" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-quobyte-e32257d5-e969-4dd5-9b24-0a5ff18ed4c9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Deleting offline snapshot e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 of volume 05977e9e-ca6d-4894-b23a-8f035e26fd66 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] snapshot_file for this snap is: volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f55cad-e2ff-48da-836d-0d2f549d9aef]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:29 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 Nov 01 09:40:29 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:29 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9" returned: 0 in 0.563s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05977e9e-ca6d-4894-b23a-8f035e26fd66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:40:30 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c83bfe-09a7-408d-ab72-d9a20cd3a5b9]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:30 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 Nov 01 09:40:30 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:31 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66" returned: 0 in 0.953s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:31 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 Nov 01 09:40:31 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:31 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9" returned: 0 in 0.871s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:31 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9 Nov 01 09:40:31 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:32 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66.e32257d5-e969-4dd5-9b24-0a5ff18ed4c9" returned: 0 in 0.574s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-quobyte-e32257d5-e969-4dd5-9b24-0a5ff18ed4c9" released by "_delete_snapshot" :: held 3.211s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-quobyte-05977e9e-ca6d-4894-b23a-8f035e26fd66" released by "delete_snapshot" :: held 3.246s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:32 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Created reservations ['62b7c8d0-5f3f-4225-a321-d65738d8ba00', '4ab9dec9-1ba0-4c4c-97ae-557e430fcb86', '978cef8f-9775-4b00-bdba-b4b7b04232f4', '35513d90-23f5-4cee-a25d-8be9d4952506'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:32 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=84,cinder:UPDATE=76,cinder:INSERT=21,cinder:DELETE=6 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:40:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Delete snapshot completed successfully. Nov 01 09:40:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b5a9ea45-c261-426b-97db-3bac19efa399 tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-e32257d5-e969-4dd5-9b24-0a5ff18ed4c9-delete_snapshot" released by "delete_snapshot" :: held 3.475s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "cinder-05977e9e-ca6d-4894-b23a-8f035e26fd66-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-05977e9e-ca6d-4894-b23a-8f035e26fd66-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "cinder-quobyte-05977e9e-ca6d-4894-b23a-8f035e26fd66" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-quobyte-05977e9e-ca6d-4894-b23a-8f035e26fd66" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:34 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adf17ff-5fe5-40e7-b88c-4e7f1c000f78]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:34 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 Nov 01 09:40:34 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:34 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66" returned: 0 in 0.598s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:34 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66 Nov 01 09:40:34 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:34 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-05977e9e-ca6d-4894-b23a-8f035e26fd66" returned: 0 in 0.345s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-quobyte-05977e9e-ca6d-4894-b23a-8f035e26fd66" released by "delete_volume" :: held 1.101s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Created reservations ['e6ca0041-446a-46bf-934a-fa88e20ada40', '6465c470-6ac2-4af0-a5e9-2524c90977e9', '65ddac7e-c083-4a89-b2e7-a26d49b873a8', '7f7e1847-682c-4430-bcd4-33db2ef9b57a'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:35 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:35 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:35 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.435s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Deleted volume successfully. Nov 01 09:40:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e53094a5-65df-4655-b982-eef04ea34adb tempest-VolumesSnapshotNegativeTestJSON-2126813613 None] Lock "cinder-05977e9e-ca6d-4894-b23a-8f035e26fd66-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:36 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9" returned: 0 in 7.615s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:36 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9, size 1024.00 MB, duration 7.62 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:40:36 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Converted 1024.00 MB image at 134.45 MB/s Nov 01 09:40:36 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 is being set with open permissions: ugo+rw Nov 01 09:40:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:36 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 Nov 01 09:40:36 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:37 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-364bcad2-7b90-42c4-a4d1-60dc68556bf9" released by "_copy_volume_from_snapshot" :: held 8.778s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-4df4189a-83f3-4579-9813-fc7aa8aa5976-364bcad2-7b90-42c4-a4d1-60dc68556bf9" released by "_create_volume_from_snapshot" :: held 8.861s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.898s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.418s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-30718701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e067bdf-0dd4-403b-af9f-d89df20dcab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee1cb0a3efb410db4609f601416fea9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:40:29Z,use_quota=True,user_id='d5fdbfcae9e0476081038f3e372cde6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Creating volume 0e067bdf-0dd4-403b-af9f-d89df20dcab6 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:40:37 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:37 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 1073741824 Nov 01 09:40:37 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44575302-b0e7-404f-b68a-a2ce1ada9508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9', 'volume_size': 1, 'snapshot_id': '4df4189a-83f3-4579-9813-fc7aa8aa5976'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38d194c-1352-4c23-9eb4-90a97118ad68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:37 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Volume volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 (364bcad2-7b90-42c4-a4d1-60dc68556bf9): created successfully Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38d194c-1352-4c23-9eb4-90a97118ad68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Flow 'volume_create_manager' (2ace1c3d-8591-4460-9a5c-b2df6f5ce2c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2a0544e8-b8fb-4a7b-8844-436e8d4cd43d tempest-VolumesSnapshotTestJSON-172522261 None] Created volume successfully. Nov 01 09:40:37 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 1073741824" returned: 0 in 0.474s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:37 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 Nov 01 09:40:37 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:37 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6" returned: 0 in 0.258s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17971e51-9895-4ce0-8b9e-37322ab0ddd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b1e4d2-2e82-476a-894f-5bd348b129ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:40:37 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Volume volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 (0e067bdf-0dd4-403b-af9f-d89df20dcab6): created successfully Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b1e4d2-2e82-476a-894f-5bd348b129ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:40:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Flow 'volume_create_manager' (4e92f4bd-7595-4949-ad33-7f67adb8d386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:40:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-60d35531-bcc1-4e93-971a-fa2c8d8b05b5 tempest-AttachVolumeTestJSON-1801423078 None] Created volume successfully. Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-364bcad2-7b90-42c4-a4d1-60dc68556bf9-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-364bcad2-7b90-42c4-a4d1-60dc68556bf9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-364bcad2-7b90-42c4-a4d1-60dc68556bf9" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-364bcad2-7b90-42c4-a4d1-60dc68556bf9" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe8a927-0172-45de-a13e-fd1f23884725]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:38 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 Nov 01 09:40:38 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:38 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9" returned: 0 in 0.395s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:38 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9 Nov 01 09:40:38 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:38 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-364bcad2-7b90-42c4-a4d1-60dc68556bf9" returned: 0 in 0.315s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-364bcad2-7b90-42c4-a4d1-60dc68556bf9" released by "delete_volume" :: held 0.756s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Created reservations ['0ae0455e-8cfd-4968-9385-26c17b20703d', '488e406b-1bbc-47dc-b0b7-77f020dcb21d', '6d7ce810-1d34-499c-861c-b1730e9cc44c', 'dba615d2-7151-4843-b5be-3185da49c39d'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:39 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:39 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-4df4189a-83f3-4579-9813-fc7aa8aa5976-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-4df4189a-83f3-4579-9813-fc7aa8aa5976-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-cc2c5547-e35a-4868-99ff-14fa3eb837d9" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-cc2c5547-e35a-4868-99ff-14fa3eb837d9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-4df4189a-83f3-4579-9813-fc7aa8aa5976" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-4df4189a-83f3-4579-9813-fc7aa8aa5976" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Deleting offline snapshot 4df4189a-83f3-4579-9813-fc7aa8aa5976 of volume cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:40:39 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] snapshot_file for this snap is: volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.429s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b82e83-cd6b-4c91-bf3e-861e16a6cd64]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Deleted volume successfully. Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-44dca7d3-1f4f-4b94-b017-eb073d57de8f req-c6a11a8b-d62e-4bdd-899c-a553855b3948 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-44dca7d3-1f4f-4b94-b017-eb073d57de8f req-c6a11a8b-d62e-4bdd-899c-a553855b3948 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-44dca7d3-1f4f-4b94-b017-eb073d57de8f req-c6a11a8b-d62e-4bdd-899c-a553855b3948 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1a3e85aa-530b-4908-8962-781238262c53 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-364bcad2-7b90-42c4-a4d1-60dc68556bf9-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-44dca7d3-1f4f-4b94-b017-eb073d57de8f req-c6a11a8b-d62e-4bdd-899c-a553855b3948 tempest-AttachVolumeTestJSON-1801423078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84432554-9a17-4b02-a62c-eb90a9edc85e', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:40:39 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 Nov 01 09:40:39 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-44dca7d3-1f4f-4b94-b017-eb073d57de8f req-c6a11a8b-d62e-4bdd-899c-a553855b3948 tempest-AttachVolumeTestJSON-1801423078 None] attachment_update completed successfully. Nov 01 09:40:40 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976" returned: 0 in 0.552s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:40:40 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2514581f-59ab-4bc5-85af-ce71f8d9065b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:40 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 Nov 01 09:40:40 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:40 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9" returned: 0 in 0.603s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:40 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 Nov 01 09:40:40 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:41 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976" returned: 0 in 0.365s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:41 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976 Nov 01 09:40:41 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:41 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9.4df4189a-83f3-4579-9813-fc7aa8aa5976" returned: 0 in 0.270s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-4df4189a-83f3-4579-9813-fc7aa8aa5976" released by "_delete_snapshot" :: held 2.034s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-cc2c5547-e35a-4868-99ff-14fa3eb837d9" released by "delete_snapshot" :: held 2.071s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:41 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Created reservations ['e23b8f84-e0c4-4e22-adc8-7252201320a0', '589de337-bf8b-4c02-ab35-f8958c185c19', '3b249d07-937e-414b-a1e9-39372e920c31', 'd1e8be3b-0647-4ce2-8cb6-5ddd9afc7acb'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Delete snapshot completed successfully. Nov 01 09:40:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-97e51698-ad9f-4de1-9aa9-1c845d2383d7 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-4df4189a-83f3-4579-9813-fc7aa8aa5976-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-51ef3523-abe7-4ebe-9694-5d80ed067af5 req-ffa20d49-810d-4892-ba72-995511bcead8 tempest-AttachVolumeTestJSON-1801423078 None] Terminate volume connection completed successfully. Nov 01 09:40:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-51ef3523-abe7-4ebe-9694-5d80ed067af5 req-ffa20d49-810d-4892-ba72-995511bcead8 tempest-AttachVolumeTestJSON-1801423078 None] Deleting attachment 558023d0-9dda-4ef5-85e5-9a4472797b72. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:40:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-cc2c5547-e35a-4868-99ff-14fa3eb837d9-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-cc2c5547-e35a-4868-99ff-14fa3eb837d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-cc2c5547-e35a-4868-99ff-14fa3eb837d9" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-cc2c5547-e35a-4868-99ff-14fa3eb837d9" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:42 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83996dd7-0524-461c-a66c-d9dd55c74319]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:43 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 Nov 01 09:40:43 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:43 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9" returned: 0 in 0.842s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:43 devstack sudo[95838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9 Nov 01 09:40:43 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:44 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc2c5547-e35a-4868-99ff-14fa3eb837d9" returned: 0 in 0.368s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-cc2c5547-e35a-4868-99ff-14fa3eb837d9" released by "delete_volume" :: held 1.342s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Created reservations ['1568b988-0cde-412e-ac5d-7042b89452d9', '55625c2d-f740-4efc-9bf2-2570efdab238', '01ebf1b7-6122-438f-9d97-8777136311d3', '15d79224-3169-4477-bb37-b7fa2919c3a5'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:44 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-78f23ee1-66c6-4824-8c1a-36ce2f259354 req-35ede543-b0ba-4e75-b2fe-6723217317ff tempest-AttachVolumeTestJSON-1801423078 None] Terminate volume connection completed successfully. Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-78f23ee1-66c6-4824-8c1a-36ce2f259354 req-35ede543-b0ba-4e75-b2fe-6723217317ff tempest-AttachVolumeTestJSON-1801423078 None] Deleting attachment 84432554-9a17-4b02-a62c-eb90a9edc85e. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:40:44 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:44 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:44 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.311s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:44 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Deleted volume successfully. Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=121,cinder:SELECT=118,cinder:INSERT=31,cinder:DELETE=13 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:40:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b563c0b1-f6e7-41b0-923d-ccaa0bfacfe1 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-cc2c5547-e35a-4868-99ff-14fa3eb837d9-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-d0010fef-ab26-4be1-927a-ef8843257609-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-d0010fef-ab26-4be1-927a-ef8843257609-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "cinder-quobyte-d0010fef-ab26-4be1-927a-ef8843257609" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-d0010fef-ab26-4be1-927a-ef8843257609" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:45 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1aefcc-173a-486e-92ae-f112cff2a0eb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:45 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 Nov 01 09:40:45 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:45 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609" returned: 0 in 0.568s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:45 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609 Nov 01 09:40:45 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:46 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d0010fef-ab26-4be1-927a-ef8843257609" returned: 0 in 0.487s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-quobyte-d0010fef-ab26-4be1-927a-ef8843257609" released by "delete_volume" :: held 1.149s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Created reservations ['dba7eeb9-49ad-47df-b220-edcdb1b0565f', '25ecfc96-d5ba-42d3-b78a-96fc9fb19a81', '9a0e770e-e758-4d14-b166-ea91d88276f2', '6509d635-5222-425a-ab3a-af7b2c8f684b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:46 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:46 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:47 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:47 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:47 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Deleted volume successfully. Nov 01 09:40:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6abf3bce-d532-430a-ab51-3cc740fd9126 tempest-VolumesSnapshotTestJSON-172522261 None] Lock "cinder-d0010fef-ab26-4be1-927a-ef8843257609-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Acquiring lock "cinder-ec3ff963-6d2d-4e9c-a31f-692a0192ceff-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "cinder-ec3ff963-6d2d-4e9c-a31f-692a0192ceff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Acquiring lock "cinder-quobyte-ec3ff963-6d2d-4e9c-a31f-692a0192ceff" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "cinder-quobyte-ec3ff963-6d2d-4e9c-a31f-692a0192ceff" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c67541d-b6be-40b6-8515-8ad125ffc404]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:48 devstack sudo[95915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff Nov 01 09:40:48 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:49 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff" returned: 0 in 0.523s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:49 devstack sudo[95920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff Nov 01 09:40:49 devstack sudo[95920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:49 devstack sudo[95920]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ec3ff963-6d2d-4e9c-a31f-692a0192ceff" returned: 0 in 0.319s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "cinder-quobyte-ec3ff963-6d2d-4e9c-a31f-692a0192ceff" released by "delete_volume" :: held 0.898s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Created reservations ['5964637c-3c05-4edc-a868-8e9e81cbde62', '8c6d276c-dc6d-401f-ab22-3b0606866e8e', '43d3bf4c-c873-4c91-a56f-8d8be4306587', 'b2359efa-db2f-4083-a6ac-f635eb00c1a6'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:49 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:49 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:50 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.325s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:50 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Deleted volume successfully. Nov 01 09:40:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-83f7e93a-4def-4be4-8d71-07a1bc91a6d7 tempest-AttachVolumeShelveTestJSON-1945982561 None] Lock "cinder-ec3ff963-6d2d-4e9c-a31f-692a0192ceff-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:53 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:53 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:53 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.286s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:40:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:40:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "cinder-0e067bdf-0dd4-403b-af9f-d89df20dcab6-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-0e067bdf-0dd4-403b-af9f-d89df20dcab6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "cinder-quobyte-0e067bdf-0dd4-403b-af9f-d89df20dcab6" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-quobyte-0e067bdf-0dd4-403b-af9f-d89df20dcab6" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[651c24cf-ba85-43c4-8ddd-439d23451bc6]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:56 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 Nov 01 09:40:56 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:56 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6" returned: 0 in 0.431s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:56 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6 Nov 01 09:40:56 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:57 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e067bdf-0dd4-403b-af9f-d89df20dcab6" returned: 0 in 0.337s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-quobyte-0e067bdf-0dd4-403b-af9f-d89df20dcab6" released by "delete_volume" :: held 0.827s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Created reservations ['e85c55b4-e877-437e-9faa-9365df3005be', '795f5d31-05ac-46e0-8e26-2eaf46c58207', '581bc0cb-0ae0-4d66-8095-e52c79349c7a', '691c7139-d246-4a4b-a041-f5baf73ad09e'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:57 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:57 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "cinder-7cd5b98e-3efa-4077-b879-07b66ed465da-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-7cd5b98e-3efa-4077-b879-07b66ed465da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "cinder-quobyte-7cd5b98e-3efa-4077-b879-07b66ed465da" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-quobyte-7cd5b98e-3efa-4077-b879-07b66ed465da" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[99454e15-baa7-4cb5-a88d-9c215c505b66]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:57 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.386s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:57 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Deleted volume successfully. Nov 01 09:40:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-662b9bf3-58bb-4ee8-b9db-8d6cee1f3a62 tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-0e067bdf-0dd4-403b-af9f-d89df20dcab6-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:57 devstack sudo[95946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da Nov 01 09:40:57 devstack sudo[95946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:58 devstack sudo[95946]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da" returned: 0 in 0.543s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:58 devstack sudo[95952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da Nov 01 09:40:58 devstack sudo[95952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:58 devstack sudo[95952]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7cd5b98e-3efa-4077-b879-07b66ed465da" returned: 0 in 0.302s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-quobyte-7cd5b98e-3efa-4077-b879-07b66ed465da" released by "delete_volume" :: held 0.928s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Created reservations ['96d9f58e-12ca-4e9c-8083-c30bc03395f4', 'faa7ac74-3843-4ed4-a790-37fbbb63625b', '996ac86f-f0bc-4229-a67d-c8a9f5aedf08', '4622a977-291d-4fef-bcbd-df13fc69158b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:40:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:40:58 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:40:58 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:40:59 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Nov 01 09:40:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.360s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:40:59 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:40:59 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Deleted volume successfully. Nov 01 09:40:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-34a43bbf-6ff6-418d-bc48-c7d5c27302b7 tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-7cd5b98e-3efa-4077-b879-07b66ed465da-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "cinder-18c20dc3-e629-4813-8997-f0f6cb8515c2-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-18c20dc3-e629-4813-8997-f0f6cb8515c2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "cinder-quobyte-18c20dc3-e629-4813-8997-f0f6cb8515c2" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-quobyte-18c20dc3-e629-4813-8997-f0f6cb8515c2" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[86034ea4-3b05-459a-8f40-3fd31ee115eb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:00 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 Nov 01 09:41:00 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:00 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2" returned: 0 in 0.562s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:00 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2 Nov 01 09:41:00 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:01 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-18c20dc3-e629-4813-8997-f0f6cb8515c2" returned: 0 in 0.421s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-quobyte-18c20dc3-e629-4813-8997-f0f6cb8515c2" released by "delete_volume" :: held 1.065s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Created reservations ['658a323b-4b24-48de-b783-99842347c326', '95bbea5b-d6f5-4cd2-aab1-aa88fe29ed6e', '1457e15f-8020-4ba5-955a-0123642c58e2', 'e7ab8b64-cce7-4c9c-bd37-d76bed1b4042'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:01 devstack sudo[95966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:41:01 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Flow 'volume_create_manager' (1d59f81b-cd26-4c24-ba9c-d7c866e4d0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e132b4d2-5cd5-43e0-b3de-dc72903e6acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e132b4d2-5cd5-43e0-b3de-dc72903e6acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-988523776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af01b46-88a8-4877-9468-73a39e930eac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ca3e76c9a0849a1a2d9076030f6200a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:02Z,use_quota=True,user_id='fc384b10a18d4b9e989e1dedaf0c02ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b49fd27-e622-4030-b0ff-2f87d5508771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b49fd27-e622-4030-b0ff-2f87d5508771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c69ae4-b4c9-40aa-bde4-6e87eb578d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c69ae4-b4c9-40aa-bde4-6e87eb578d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af01b46-88a8-4877-9468-73a39e930eac', 'volume_name': 'volume-2af01b46-88a8-4877-9468-73a39e930eac', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d91b56f-bd0f-4150-8cc0-4cfa914918b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d91b56f-bd0f-4150-8cc0-4cfa914918b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935f6541-afdb-4bf1-b287-800c34d9124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:01 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Volume 2af01b46-88a8-4877-9468-73a39e930eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af01b46-88a8-4877-9468-73a39e930eac', 'volume_size': 1} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-988523776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af01b46-88a8-4877-9468-73a39e930eac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6ca3e76c9a0849a1a2d9076030f6200a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:02Z,use_quota=True,user_id='fc384b10a18d4b9e989e1dedaf0c02ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Creating volume 2af01b46-88a8-4877-9468-73a39e930eac {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:41:01 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:01 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac 1073741824 Nov 01 09:41:01 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:01 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.445s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:41:01 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Deleted volume successfully. Nov 01 09:41:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-984b2a23-3ed3-4707-8cff-113ace5b0dcc tempest-AttachVolumeTestJSON-1801423078 None] Lock "cinder-18c20dc3-e629-4813-8997-f0f6cb8515c2-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Flow 'volume_create_manager' (c6be8390-6f4e-42a6-b92f-ca00e575e2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471d1c00-1680-4246-831d-b25bdd3413ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471d1c00-1680-4246-831d-b25bdd3413ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1654972025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af552e5f881f49e68f5dae2c0ce04a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:02Z,use_quota=True,user_id='c20f622a5f1d4c1a97ddeda154869a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6faa81-99fc-4417-808e-44ad8c532661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd6faa81-99fc-4417-808e-44ad8c532661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c826a97-4eaa-4d73-9056-c5affcc7a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c826a97-4eaa-4d73-9056-c5affcc7a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942', 'volume_name': 'volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a905cc8d-ced3-45f4-97fb-9aaf194de625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a905cc8d-ced3-45f4-97fb-9aaf194de625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e8c644-2aaa-4200-8695-6259a1f811ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:02 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Volume c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942', 'volume_size': 1} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:02 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac 1073741824" returned: 0 in 0.617s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:02 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac Nov 01 09:41:02 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:02 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac" returned: 0 in 0.316s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.425s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1654972025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af552e5f881f49e68f5dae2c0ce04a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:02Z,use_quota=True,user_id='c20f622a5f1d4c1a97ddeda154869a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Creating volume c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:41:02 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935f6541-afdb-4bf1-b287-800c34d9124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af01b46-88a8-4877-9468-73a39e930eac', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517644fa-5cc0-48fb-9e17-4f896febc4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:02 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 1073741824 Nov 01 09:41:02 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:02 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Volume volume-2af01b46-88a8-4877-9468-73a39e930eac (2af01b46-88a8-4877-9468-73a39e930eac): created successfully Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517644fa-5cc0-48fb-9e17-4f896febc4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Flow 'volume_create_manager' (1d59f81b-cd26-4c24-ba9c-d7c866e4d0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:02 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-4ddbafcd-ece1-4dde-9cd6-627996934e8a req-13b62840-4b53-4719-a226-464d70d09bf7 tempest-VolumesGetTestJSON-1898217612 None] Created volume successfully. Nov 01 09:41:03 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 1073741824" returned: 0 in 0.531s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:03 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 Nov 01 09:41:03 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:03 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" returned: 0 in 0.295s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e8c644-2aaa-4200-8695-6259a1f811ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de946fcb-3ef6-4da3-9d56-5ef667d936c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:03 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Volume volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 (c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942): created successfully Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de946fcb-3ef6-4da3-9d56-5ef667d936c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Flow 'volume_create_manager' (c6be8390-6f4e-42a6-b92f-ca00e575e2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:03 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5febd260-87d2-4c77-b391-78850ff597dc tempest-VolumesSnapshotListTestJSON-1574820133 None] Created volume successfully. Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Acquiring lock "cinder-2af01b46-88a8-4877-9468-73a39e930eac-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Lock "cinder-2af01b46-88a8-4877-9468-73a39e930eac-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Acquiring lock "cinder-quobyte-2af01b46-88a8-4877-9468-73a39e930eac" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Lock "cinder-quobyte-2af01b46-88a8-4877-9468-73a39e930eac" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1acee7-5f1b-4c7c-acbf-fe65bfebba41]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Creating offline snapshot d69f37d9-5410-4232-ae6d-8134ba21a54f of volume c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6bd880-7fdd-45af-9d1c-7f6851f1a2a2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:04 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac Nov 01 09:41:04 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:04 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 Nov 01 09:41:04 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:05 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac" returned: 0 in 0.544s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:05 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac Nov 01 09:41:05 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:05 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" returned: 0 in 0.756s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:05 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f 1G Nov 01 09:41:05 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:05 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2af01b46-88a8-4877-9468-73a39e930eac" returned: 0 in 0.423s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Lock "cinder-quobyte-2af01b46-88a8-4877-9468-73a39e930eac" released by "delete_volume" :: held 1.056s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG cinder.quota [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Created reservations ['2eb5d8cf-2503-4c60-9e87-7b0980bf8ebf', '124ff426-9310-4656-82f9-e349059db7d2', '9c8389fd-0275-4d89-8162-2589d290ab71', '92d5aa5f-faf0-4d5e-b695-9e3f8ba9d800'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:05 devstack sudo[96006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:41:05 devstack sudo[96006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:05 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f 1G" returned: 0 in 0.610s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:06 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f Nov 01 09:41:06 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:06 devstack sudo[96006]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.363s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG cinder.manager [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:41:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Deleted volume successfully. Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-0b3e4006-21ce-433a-8c8d-557f493ac67e req-e5ed5940-f30e-4b9b-8ee5-e7ea0e0a1607 tempest-VolumesGetTestJSON-1898217612 None] Lock "cinder-2af01b46-88a8-4877-9468-73a39e930eac-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:06 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f" returned: 0 in 0.364s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:06 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f is being set with open permissions: ugo+rw Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:06 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f Nov 01 09:41:06 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:06 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f" returned: 0 in 0.438s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:06 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.info Nov 01 09:41:06 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:07 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.info" returned: 0 in 0.334s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:07 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.info is being set with open permissions: ugo+rw Nov 01 09:41:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:07 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.info Nov 01 09:41:07 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:07 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.info" returned: 0 in 0.278s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:07 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ea8fd8e1-244b-4fac-8286-7de5f3f2f3df tempest-VolumesSnapshotListTestJSON-1574820133 None] Create snapshot completed successfully Nov 01 09:41:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Creating offline snapshot fc28c193-2de0-4257-bfcc-abf5999ee4bc of volume c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:41:08 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8080e4f2-051c-4978-a8f5-8a8f8e9ed5eb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:08 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f Nov 01 09:41:08 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:08 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f" returned: 0 in 0.488s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:41:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:08 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc 1G Nov 01 09:41:08 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:09 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc 1G" returned: 0 in 0.675s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:09 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc Nov 01 09:41:09 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:09 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc" returned: 0 in 0.417s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:09 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc is being set with open permissions: ugo+rw Nov 01 09:41:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:09 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc Nov 01 09:41:09 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:10 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc" returned: 0 in 0.317s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3476cb03-b835-4bb3-b61f-3afec18dbe8e tempest-VolumesSnapshotListTestJSON-1574820133 None] Create snapshot completed successfully Nov 01 09:41:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Creating offline snapshot cd4b38e2-0347-4b1b-80a8-edd162643c30 of volume c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:41:11 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c86dbc-1950-426f-b881-0727f4d1e3d7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:11 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc Nov 01 09:41:11 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:11 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc" returned: 0 in 0.447s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:41:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:12 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 1G Nov 01 09:41:12 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Flow 'volume_create_manager' (84b8d5d8-dcce-41d3-aebe-09484706aebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82327c2-0e3e-43cf-b0f7-6a140fa6ab8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82327c2-0e3e-43cf-b0f7-6a140fa6ab8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-33344555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813972db-2aa4-4808-9924-79788cefc791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f495fe698942b0b5dbc2009d552f72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:12Z,use_quota=True,user_id='53de8124f9324054af443c36b46643d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59c64db-5c4b-40fe-914a-956f739d2f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59c64db-5c4b-40fe-914a-956f739d2f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:12 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13579dfd-515e-4378-b492-ed65bcf67029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 1G" returned: 0 in 0.662s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:12 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 Nov 01 09:41:12 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:13 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30" returned: 0 in 0.464s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:13 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 is being set with open permissions: ugo+rw Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:13 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 Nov 01 09:41:13 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13579dfd-515e-4378-b492-ed65bcf67029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '813972db-2aa4-4808-9924-79788cefc791', 'volume_name': 'volume-813972db-2aa4-4808-9924-79788cefc791', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8820cf-1406-417b-bbd2-6bb72b4414d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd8820cf-1406-417b-bbd2-6bb72b4414d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee2c616-0b7a-44da-8d0c-691a53f7d546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Volume 813972db-2aa4-4808-9924-79788cefc791: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-813972db-2aa4-4808-9924-79788cefc791', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Trying to clone 813972db-2aa4-4808-9924-79788cefc791 from image c507ec59-c87f-4d5c-be6c-eab60d7c916d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:41:13 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30" returned: 0 in 0.394s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.134s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:13 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2a50dbb7-4317-4d39-b00d-c983d496a23c tempest-VolumesSnapshotListTestJSON-1574820133 None] Create snapshot completed successfully Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:41:13 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Image download 20.69 MB at 20.69 MB/s Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b8686a-c029-4c9c-86a1-f897c9681abe]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:13 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD Nov 01 09:41:13 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:14 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD" returned: 0 in 0.411s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d is fetched for user 53de8124f9324054af443c36b46643d6. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2154a0-0102-4afc-9e99-787a8f9aacd3]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:14 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD Nov 01 09:41:14 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:14 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-33344555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=813972db-2aa4-4808-9924-79788cefc791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9f495fe698942b0b5dbc2009d552f72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:12Z,use_quota=True,user_id='53de8124f9324054af443c36b46643d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Creating volume 813972db-2aa4-4808-9924-79788cefc791 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:41:14 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:41:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:14 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 1073741824 Nov 01 09:41:14 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:15 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 1073741824" returned: 0 in 0.612s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:15 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 Nov 01 09:41:15 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-cd4b38e2-0347-4b1b-80a8-edd162643c30-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:15 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791" returned: 0 in 0.392s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-cd4b38e2-0347-4b1b-80a8-edd162643c30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Attempting download of c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 813972db-2aa4-4808-9924-79788cefc791. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-quobyte-cd4b38e2-0347-4b1b-80a8-edd162643c30" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-cd4b38e2-0347-4b1b-80a8-edd162643c30" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Deleting offline snapshot cd4b38e2-0347-4b1b-80a8-edd162643c30 of volume c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] snapshot_file for this snap is: volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b08d0c0-2560-44cd-b941-8da743091a5a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0bf53f-eaaf-4f42-aeb0-073461e71426]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4jfbzqsn {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:16 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 Nov 01 09:41:16 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:16 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4jfbzqsn Nov 01 09:41:16 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:16 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4jfbzqsn" returned: 0 in 0.399s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4jfbzqsn {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:16 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30" returned: 0 in 0.443s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c146ee6f-9b8f-42e8-a173-21908ef56b62]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:16 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4jfbzqsn Nov 01 09:41:16 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:16 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc Nov 01 09:41:16 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:16 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4jfbzqsn" returned: 1 in 0.404s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4jfbzqsn' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4112c4-b389-4ba7-bcb8-aea2e68d9060]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:16 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD Nov 01 09:41:16 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:16 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc" returned: 0 in 0.513s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:41:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:16 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 Nov 01 09:41:16 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:17 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:17 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] c507ec59-c87f-4d5c-be6c-eab60d7c916d was qcow2, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:41:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:17 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 Nov 01 09:41:17 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:17 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30" returned: 0 in 0.584s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:17 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30 Nov 01 09:41:17 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:17 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.cd4b38e2-0347-4b1b-80a8-edd162643c30" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-cd4b38e2-0347-4b1b-80a8-edd162643c30" released by "_delete_snapshot" :: held 2.075s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" released by "delete_snapshot" :: held 2.106s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:18 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Created reservations ['655303cd-f931-43e9-a654-108d48e08ee2', '1628a99a-0da2-4374-b847-b88c6f8df349', '97953d8d-8e35-415e-a58f-0cb01a529c89', 'ab1f72a5-1e3c-4f85-b5b9-ea5914b7dc83'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:41:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Delete snapshot completed successfully. Nov 01 09:41:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-421c2bd8-937d-44ec-ad73-a4e5badb4d99 tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-cd4b38e2-0347-4b1b-80a8-edd162643c30-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-fc28c193-2de0-4257-bfcc-abf5999ee4bc-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-fc28c193-2de0-4257-bfcc-abf5999ee4bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-quobyte-fc28c193-2de0-4257-bfcc-abf5999ee4bc" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-fc28c193-2de0-4257-bfcc-abf5999ee4bc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Deleting offline snapshot fc28c193-2de0-4257-bfcc-abf5999ee4bc of volume c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] snapshot_file for this snap is: volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea08d92-26e8-495c-96bc-5850572f9c76]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:19 devstack sudo[96132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc Nov 01 09:41:19 devstack sudo[96132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:19 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791" returned: 0 in 2.627s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_2uf3yvx_devstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:41:19 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Converted 112.00 MB image at 42.61 MB/s Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:19 devstack sudo[96132]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc" returned: 0 in 0.536s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:41:19 devstack sudo[96138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 1G Nov 01 09:41:19 devstack sudo[96138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e42bcc-5eca-42bb-8b96-967cff77b454]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:20 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f Nov 01 09:41:20 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:20 devstack sudo[96138]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 1G" returned: 0 in 0.593s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Downloaded image c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 813972db-2aa4-4808-9924-79788cefc791 successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d for user 53de8124f9324054af443c36b46643d6 is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Marking volume 813972db-2aa4-4808-9924-79788cefc791 as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:41:20 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f" returned: 0 in 0.570s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Copying metadata from image c507ec59-c87f-4d5c-be6c-eab60d7c916d to 813972db-2aa4-4808-9924-79788cefc791. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Creating volume glance metadata for volume 813972db-2aa4-4808-9924-79788cefc791 backed by image c507ec59-c87f-4d5c-be6c-eab60d7c916d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:41:20 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc Nov 01 09:41:20 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee2c616-0b7a-44da-8d0c-691a53f7d546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-813972db-2aa4-4808-9924-79788cefc791', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c34dd6-1a23-4315-b1f2-d93e0d1866af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:20 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Volume volume-813972db-2aa4-4808-9924-79788cefc791 (813972db-2aa4-4808-9924-79788cefc791): created successfully Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c34dd6-1a23-4315-b1f2-d93e0d1866af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Flow 'volume_create_manager' (84b8d5d8-dcce-41d3-aebe-09484706aebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bfe21033-a5ef-48ea-95ca-bb87b56dd240 tempest-TestShelveInstance-1738689165 None] Created volume successfully. Nov 01 09:41:20 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc" returned: 0 in 0.517s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:20 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc Nov 01 09:41:20 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:21 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.fc28c193-2de0-4257-bfcc-abf5999ee4bc" returned: 0 in 0.416s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-fc28c193-2de0-4257-bfcc-abf5999ee4bc" released by "_delete_snapshot" :: held 2.185s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" released by "delete_snapshot" :: held 2.223s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:21 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Created reservations ['d605e9f6-6374-465e-9e62-379e4892802a', 'c9d7da10-e550-4bb3-a0b8-3c056428ec63', 'fd8fc08d-4b92-4613-b301-ea18709353eb', '7f691ab1-d102-4db1-96a8-b5128a1f24c9'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:41:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Delete snapshot completed successfully. Nov 01 09:41:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-18d07acf-344e-4462-9c11-bbd1326c846c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-fc28c193-2de0-4257-bfcc-abf5999ee4bc-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-d69f37d9-5410-4232-ae6d-8134ba21a54f-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-d69f37d9-5410-4232-ae6d-8134ba21a54f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-quobyte-d69f37d9-5410-4232-ae6d-8134ba21a54f" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-d69f37d9-5410-4232-ae6d-8134ba21a54f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Deleting offline snapshot d69f37d9-5410-4232-ae6d-8134ba21a54f of volume c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] snapshot_file for this snap is: volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[623db7ef-e266-49bb-a498-9aac19607afe]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:22 devstack sudo[96157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f Nov 01 09:41:22 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f" returned: 0 in 0.447s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:41:23 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:23 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea20bc78-72e1-45a6-ace5-a2623a13f828]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:23 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 Nov 01 09:41:23 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:23 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" returned: 0 in 0.571s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:23 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f Nov 01 09:41:23 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Flow 'volume_create_manager' (5a5d0a2d-0bdf-459b-b1bd-3dd38d871d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2afb59-96e9-45af-8c24-a0c4ac001ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e2afb59-96e9-45af-8c24-a0c4ac001ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1729743878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b087a5f1-9334-4b15-89de-68d7836019da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f574f67db2243e088798c5162619a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:24Z,use_quota=True,user_id='215d1b03a175416883231a9d50048896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d853361c-433a-437f-9083-4f5029ece25a),volume_type_id=d853361c-433a-437f-9083-4f5029ece25a)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c69348b-8bc5-4991-ae7e-6e431ffae3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c69348b-8bc5-4991-ae7e-6e431ffae3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8a7232-f9da-478d-8973-4550be6c901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8a7232-f9da-478d-8973-4550be6c901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b087a5f1-9334-4b15-89de-68d7836019da', 'volume_name': 'volume-b087a5f1-9334-4b15-89de-68d7836019da', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326ed9c1-ef9b-42a3-9c92-2f91b4196f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326ed9c1-ef9b-42a3-9c92-2f91b4196f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32702a99-3be2-4bc7-94d7-02d1784ab09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:24 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Volume b087a5f1-9334-4b15-89de-68d7836019da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b087a5f1-9334-4b15-89de-68d7836019da', 'volume_size': 1} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1729743878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b087a5f1-9334-4b15-89de-68d7836019da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f574f67db2243e088798c5162619a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:24Z,use_quota=True,user_id='215d1b03a175416883231a9d50048896',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d853361c-433a-437f-9083-4f5029ece25a),volume_type_id=d853361c-433a-437f-9083-4f5029ece25a)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Creating volume b087a5f1-9334-4b15-89de-68d7836019da {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:24 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:41:24 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f" returned: 0 in 0.522s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:24 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da 1073741824 Nov 01 09:41:24 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:24 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f Nov 01 09:41:24 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:24 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942.d69f37d9-5410-4232-ae6d-8134ba21a54f" returned: 0 in 0.374s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-d69f37d9-5410-4232-ae6d-8134ba21a54f" released by "_delete_snapshot" :: held 2.121s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" released by "delete_snapshot" :: held 2.157s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Created reservations ['9f7b8daf-9b4d-4100-9aa0-5fc99984e142', '8c1d87b7-39d6-4d3a-a140-db5013a4e0f9', '48d1fdc0-3a02-4537-b737-1db52c9bea2a', '65b24850-dba0-4d61-bfe8-a6a56e2ab5c4'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:41:24 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Delete snapshot completed successfully. Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-21c623be-2b3f-4c4b-9fa2-92d816d2242c tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-d69f37d9-5410-4232-ae6d-8134ba21a54f-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:24 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da 1073741824" returned: 0 in 0.694s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:24 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da Nov 01 09:41:24 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:25 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da" returned: 0 in 0.353s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32702a99-3be2-4bc7-94d7-02d1784ab09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b087a5f1-9334-4b15-89de-68d7836019da', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa57952-509e-4292-bf2a-3eb707879e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-ef0d2ce0-463e-48c3-a7c2-a6a5cfce1355 req-4ed49682-7e95-4f04-8a6e-3529c63d9ddc tempest-TestShelveInstance-1738689165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-ef0d2ce0-463e-48c3-a7c2-a6a5cfce1355 req-4ed49682-7e95-4f04-8a6e-3529c63d9ddc tempest-TestShelveInstance-1738689165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:25 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Volume volume-b087a5f1-9334-4b15-89de-68d7836019da (b087a5f1-9334-4b15-89de-68d7836019da): created successfully Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa57952-509e-4292-bf2a-3eb707879e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Flow 'volume_create_manager' (5a5d0a2d-0bdf-459b-b1bd-3dd38d871d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-ef0d2ce0-463e-48c3-a7c2-a6a5cfce1355 req-4ed49682-7e95-4f04-8a6e-3529c63d9ddc tempest-TestShelveInstance-1738689165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fb71c597-27da-4d40-8a10-f47b3c0c897a tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Created volume successfully. Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-ef0d2ce0-463e-48c3-a7c2-a6a5cfce1355 req-4ed49682-7e95-4f04-8a6e-3529c63d9ddc tempest-TestShelveInstance-1738689165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-813972db-2aa4-4808-9924-79788cefc791', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0ee9148-de31-4dc7-819d-2967e7bd7698', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:41:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-ef0d2ce0-463e-48c3-a7c2-a6a5cfce1355 req-4ed49682-7e95-4f04-8a6e-3529c63d9ddc tempest-TestShelveInstance-1738689165 None] attachment_update completed successfully. Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" acquired by "delete_volume" :: waited 0.056s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef532d47-b94e-4220-abc7-cbd9c0e2459a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:26 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 Nov 01 09:41:26 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:26 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" returned: 0 in 0.519s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:26 devstack sudo[96203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942 Nov 01 09:41:26 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:26 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:41:26 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:26 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" returned: 0 in 0.343s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-quobyte-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942" released by "delete_volume" :: held 0.975s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:26 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Created reservations ['8ddb4620-c3d2-4031-bec5-6d63e4a586c9', 'df0ecf7d-f2c2-4ed2-9246-4ba78e01e4d2', '26f77bd5-fcc9-467c-a1e2-0e283d203520', '8e112a09-aea4-4783-8ee0-1a90d8b89709'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:27 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.383s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:41:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-dc170c18-4d18-46d6-840b-4e57c4679de6 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Retype volume completed successfully. Nov 01 09:41:27 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:41:27 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:27 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.301s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:41:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Deleted volume successfully. Nov 01 09:41:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-94520af9-dc67-4ab2-988e-5d9e045b450d tempest-VolumesSnapshotListTestJSON-1574820133 None] Lock "cinder-c0a29a59-c9b0-4a78-8fc0-ed23dc5a6942-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Acquiring lock "cinder-b087a5f1-9334-4b15-89de-68d7836019da-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "cinder-b087a5f1-9334-4b15-89de-68d7836019da-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Acquiring lock "cinder-quobyte-b087a5f1-9334-4b15-89de-68d7836019da" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "cinder-quobyte-b087a5f1-9334-4b15-89de-68d7836019da" acquired by "delete_volume" :: waited 0.035s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6f0f70-e86e-4b90-91bb-3f37e5d6d210]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:28 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da Nov 01 09:41:28 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:29 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da" returned: 0 in 0.806s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:29 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da Nov 01 09:41:29 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:29 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b087a5f1-9334-4b15-89de-68d7836019da" returned: 0 in 0.469s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "cinder-quobyte-b087a5f1-9334-4b15-89de-68d7836019da" released by "delete_volume" :: held 1.368s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:29 devstack cinder-volume[86594]: WARNING cinder.quota [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:41:29 devstack cinder-volume[86594]: WARNING cinder.quota [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:41:29 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Created reservations ['0f88b182-e745-4986-b2f2-a98e58ae4d1f', '1e5cdf1f-7646-425b-9e74-ed14011ff1ec', '6f824ac0-13e6-4582-9216-25ecc5d3a380', '26e02cb0-b2e5-4fa5-a8c8-f5da067e6c26'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:41:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:30 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:41:30 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:30 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.358s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:30 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:41:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Deleted volume successfully. Nov 01 09:41:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-77475719-580d-47a4-8d5c-a36e23236da3 tempest-VolumeRetypeWithoutMigrationTest-175953809 None] Lock "cinder-b087a5f1-9334-4b15-89de-68d7836019da-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:39 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=146,cinder:SELECT=122,cinder:INSERT=34,cinder:DELETE=8 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:41:40 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=99,cinder:SELECT=94,cinder:INSERT=34,cinder:DELETE=9 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Flow 'volume_create_manager' (2edaaaf1-bf1e-4b1d-8c44-3d707d34c5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90724d2c-bc98-46ab-a6e0-30da247417f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90724d2c-bc98-46ab-a6e0-30da247417f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1721654875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce46816-5951-4b01-a455-343cdc0a1c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f02841de3f3408aa6574d22bed2c44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:45Z,use_quota=True,user_id='ac59caebd2964282a59e3e60e6aed85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746f65e7-dd1f-49e1-9d82-b09b23d98349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746f65e7-dd1f-49e1-9d82-b09b23d98349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8a6a8e-1cb0-4236-9462-23e35f941f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8a6a8e-1cb0-4236-9462-23e35f941f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce46816-5951-4b01-a455-343cdc0a1c3c', 'volume_name': 'volume-dce46816-5951-4b01-a455-343cdc0a1c3c', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d31e341-ea1a-4f8b-abf4-b3bdc6161072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d31e341-ea1a-4f8b-abf4-b3bdc6161072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9913243-34f1-415c-aa1f-f1d057e39fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:45 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Volume dce46816-5951-4b01-a455-343cdc0a1c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce46816-5951-4b01-a455-343cdc0a1c3c', 'volume_size': 1} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1721654875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce46816-5951-4b01-a455-343cdc0a1c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f02841de3f3408aa6574d22bed2c44e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:41:45Z,use_quota=True,user_id='ac59caebd2964282a59e3e60e6aed85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Creating volume dce46816-5951-4b01-a455-343cdc0a1c3c {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:41:45 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:41:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:45 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c 1073741824 Nov 01 09:41:45 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:46 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c 1073741824" returned: 0 in 1.097s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:46 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c Nov 01 09:41:46 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:46 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c" returned: 0 in 0.370s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9913243-34f1-415c-aa1f-f1d057e39fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce46816-5951-4b01-a455-343cdc0a1c3c', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1971228-e818-4b9e-abfd-9b1e86c3d6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:41:46 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Volume volume-dce46816-5951-4b01-a455-343cdc0a1c3c (dce46816-5951-4b01-a455-343cdc0a1c3c): created successfully Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1971228-e818-4b9e-abfd-9b1e86c3d6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:41:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Flow 'volume_create_manager' (2edaaaf1-bf1e-4b1d-8c44-3d707d34c5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:41:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ff96c950-4bb9-4a65-93e1-5b4234b1e57c tempest-VolumesServicesTestJSON-1387671549 None] Created volume successfully. Nov 01 09:41:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Acquiring lock "cinder-dce46816-5951-4b01-a455-343cdc0a1c3c-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Lock "cinder-dce46816-5951-4b01-a455-343cdc0a1c3c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Acquiring lock "cinder-quobyte-dce46816-5951-4b01-a455-343cdc0a1c3c" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:41:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Lock "cinder-quobyte-dce46816-5951-4b01-a455-343cdc0a1c3c" acquired by "delete_volume" :: waited 0.048s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:41:47 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19b1771-7350-405b-bc64-6c6ea648948d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:41:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:47 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c Nov 01 09:41:47 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:48 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c" returned: 0 in 0.859s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:48 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c Nov 01 09:41:48 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:48 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dce46816-5951-4b01-a455-343cdc0a1c3c" returned: 0 in 0.508s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Lock "cinder-quobyte-dce46816-5951-4b01-a455-343cdc0a1c3c" released by "delete_volume" :: held 1.455s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Created reservations ['7639af6d-7992-40ba-8058-6e1eb0f25e60', '628ae910-b318-41c8-8872-6d23ce06092a', '92bc82d9-0c0d-4b4b-a1da-3566dfbb863c', 'c8dd37f2-8dd2-465e-a348-2a48ecf70979'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:49 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:41:49 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:49 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.415s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:41:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Deleted volume successfully. Nov 01 09:41:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5302ee26-f012-44fc-b051-22f3828d47fb tempest-VolumesServicesTestJSON-1387671549 None] Lock "cinder-dce46816-5951-4b01-a455-343cdc0a1c3c-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:41:53 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:41:53 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:41:53 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.314s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:41:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:41:59 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=8,cinder:UPDATE=13,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:41:59 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:42:05 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-f5423e6d-8667-4f99-b21c-2b3a94c5fae7 req-092ba3ce-12ae-4560-9d68-a6186ca63e7a tempest-TestShelveInstance-1738689165 None] Terminate volume connection completed successfully. Nov 01 09:42:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-f5423e6d-8667-4f99-b21c-2b3a94c5fae7 req-092ba3ce-12ae-4560-9d68-a6186ca63e7a tempest-TestShelveInstance-1738689165 None] Deleting attachment f0ee9148-de31-4dc7-819d-2967e7bd7698. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:42:09 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:42:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Flow 'volume_create_manager' (60c5f4d8-2278-48b6-bd9f-00c395b84bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a4cb89-4933-4c34-ba1a-c4d0fafbf8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a4cb89-4933-4c34-ba1a-c4d0fafbf8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1705072308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372a858a-e5f8-4e5d-b567-dab7cf04b83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b10a866ca74796b00731bbdb648f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:10Z,use_quota=True,user_id='de97136f5d304a968e5883bbd023c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5324fe9b-857b-46ce-ba0c-1160eb2cd151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5324fe9b-857b-46ce-ba0c-1160eb2cd151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590e2809-3201-4f7b-aace-56089517c2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590e2809-3201-4f7b-aace-56089517c2a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372a858a-e5f8-4e5d-b567-dab7cf04b83b', 'volume_name': 'volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a091f5-87a7-4f4b-9ecf-f0d6c38558df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a091f5-87a7-4f4b-9ecf-f0d6c38558df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6221c46-218b-4b9f-be69-fc8b7d6ab9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Volume 372a858a-e5f8-4e5d-b567-dab7cf04b83b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b', 'volume_size': 1} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1705072308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372a858a-e5f8-4e5d-b567-dab7cf04b83b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b10a866ca74796b00731bbdb648f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:10Z,use_quota=True,user_id='de97136f5d304a968e5883bbd023c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Creating volume 372a858a-e5f8-4e5d-b567-dab7cf04b83b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:42:10 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-a0778d55-ae6c-4f3c-a7e6-6cd8af401b6f req-852571f5-eeeb-4f07-800f-45fc220c836c tempest-TestShelveInstance-1738689165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:10 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b 1073741824 Nov 01 09:42:10 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:10 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b 1073741824" returned: 0 in 0.631s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:10 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b Nov 01 09:42:10 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Flow 'volume_create_manager' (f028bc30-8d3f-44d6-a880-5948ceab9baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016f4fde-0191-4420-8829-ff9613abf651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016f4fde-0191-4420-8829-ff9613abf651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-931897550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce575831-a8c0-4523-b24c-e831cdb17b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2695506c6240d6b003cff21251d7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:11Z,use_quota=True,user_id='108c50fd953d4620af28ce75daadef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36c4c4c4-ae17-4ddd-a5bf-f4116790396f),volume_type_id=36c4c4c4-ae17-4ddd-a5bf-f4116790396f)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c550c722-7b53-4810-9e42-f987fc677ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c550c722-7b53-4810-9e42-f987fc677ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001b86af-cfd0-4546-b215-f0d0d9f128e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001b86af-cfd0-4546-b215-f0d0d9f128e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce575831-a8c0-4523-b24c-e831cdb17b42', 'volume_name': 'volume-ce575831-a8c0-4523-b24c-e831cdb17b42', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea9e267-8aab-4598-b141-6436ac71d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea9e267-8aab-4598-b141-6436ac71d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7375b734-f67c-4ac2-9881-3d3121657cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:10 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Volume ce575831-a8c0-4523-b24c-e831cdb17b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce575831-a8c0-4523-b24c-e831cdb17b42', 'volume_size': 1} Nov 01 09:42:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:11 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b" returned: 0 in 0.410s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-a0778d55-ae6c-4f3c-a7e6-6cd8af401b6f req-852571f5-eeeb-4f07-800f-45fc220c836c tempest-TestShelveInstance-1738689165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.068s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6221c46-218b-4b9f-be69-fc8b7d6ab9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbf4425-983b-4d49-84a5-ce4de2f40248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-a0778d55-ae6c-4f3c-a7e6-6cd8af401b6f req-852571f5-eeeb-4f07-800f-45fc220c836c tempest-TestShelveInstance-1738689165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.070s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-931897550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce575831-a8c0-4523-b24c-e831cdb17b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2695506c6240d6b003cff21251d7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:11Z,use_quota=True,user_id='108c50fd953d4620af28ce75daadef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36c4c4c4-ae17-4ddd-a5bf-f4116790396f),volume_type_id=36c4c4c4-ae17-4ddd-a5bf-f4116790396f)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Creating volume ce575831-a8c0-4523-b24c-e831cdb17b42 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:42:11 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:11 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 1073741824 Nov 01 09:42:11 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:11 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Volume volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b (372a858a-e5f8-4e5d-b567-dab7cf04b83b): created successfully Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbf4425-983b-4d49-84a5-ce4de2f40248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Flow 'volume_create_manager' (60c5f4d8-2278-48b6-bd9f-00c395b84bcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-dc89d175-ce62-4cfe-ba59-9de501d11783 tempest-AttachVolumeNegativeTest-1317075963 None] Created volume successfully. Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Flow 'volume_create_manager' (5ee74b79-6d87-401a-b7f7-a9a5e5a1b362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cf33cf-b09f-4dfd-a91d-f8aac9b6d30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cf33cf-b09f-4dfd-a91d-f8aac9b6d30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1221881793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2695506c6240d6b003cff21251d7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:11Z,use_quota=True,user_id='108c50fd953d4620af28ce75daadef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9e28e6a-31b4-4262-ac3f-c4f065a709e9),volume_type_id=e9e28e6a-31b4-4262-ac3f-c4f065a709e9)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b4c3c9-17ef-4459-9d7b-5c807744c072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44b4c3c9-17ef-4459-9d7b-5c807744c072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f160e76-8549-45b2-82fd-2182de9d24d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f160e76-8549-45b2-82fd-2182de9d24d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4', 'volume_name': 'volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cec182f-bc6b-4270-9b57-76190f8807ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cec182f-bc6b-4270-9b57-76190f8807ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab764baf-f636-428d-9ff7-bf85297c5b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:11 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Volume ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4', 'volume_size': 1} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-a0778d55-ae6c-4f3c-a7e6-6cd8af401b6f req-852571f5-eeeb-4f07-800f-45fc220c836c tempest-TestShelveInstance-1738689165 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-813972db-2aa4-4808-9924-79788cefc791', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46edc01b-ed32-49cd-bdbb-586f7d0d9bd9', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:42:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-a0778d55-ae6c-4f3c-a7e6-6cd8af401b6f req-852571f5-eeeb-4f07-800f-45fc220c836c tempest-TestShelveInstance-1738689165 None] attachment_update completed successfully. Nov 01 09:42:11 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 1073741824" returned: 0 in 0.685s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:12 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 Nov 01 09:42:12 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Flow 'volume_create_manager' (691255be-6477-4e3a-b06f-b7b72fcc9979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb88240-4e6d-4190-aaef-dfa269ccd530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eb88240-4e6d-4190-aaef-dfa269ccd530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1696778212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09eaab6-9ae5-4a30-9dcd-5e56808cf07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2695506c6240d6b003cff21251d7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:12Z,use_quota=True,user_id='108c50fd953d4620af28ce75daadef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc71e751-7724-4767-a6b5-b4a42de8845a),volume_type_id=bc71e751-7724-4767-a6b5-b4a42de8845a)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8548bd28-b483-4c53-840c-d64ce1f2bccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8548bd28-b483-4c53-840c-d64ce1f2bccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c682b8-b7fd-47bf-bec3-b84fb2628467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:42:12 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42" returned: 0 in 0.421s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.938s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1221881793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2695506c6240d6b003cff21251d7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:11Z,use_quota=True,user_id='108c50fd953d4620af28ce75daadef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9e28e6a-31b4-4262-ac3f-c4f065a709e9),volume_type_id=e9e28e6a-31b4-4262-ac3f-c4f065a709e9)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Creating volume ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:42:12 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7375b734-f67c-4ac2-9881-3d3121657cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce575831-a8c0-4523-b24c-e831cdb17b42', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:12 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 1073741824 Nov 01 09:42:12 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b18eaf-7234-4ea2-9367-f6d568bc0144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Volume volume-ce575831-a8c0-4523-b24c-e831cdb17b42 (ce575831-a8c0-4523-b24c-e831cdb17b42): created successfully Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09b18eaf-7234-4ea2-9367-f6d568bc0144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Flow 'volume_create_manager' (f028bc30-8d3f-44d6-a880-5948ceab9baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:12 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ccabeeff-5e25-427e-8da0-45f86f0ff2c0 tempest-TestInstancesWithCinderVolumes-103268201 None] Created volume successfully. Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c682b8-b7fd-47bf-bec3-b84fb2628467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b09eaab6-9ae5-4a30-9dcd-5e56808cf07f', 'volume_name': 'volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f', 'volume_size': 1, 'image_id': '7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1733860871', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c2695506c6240d6b003cff21251d7af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'created_at': datetime.datetime(2026, 11, 1, 8, 42, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 42, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1/file', 'properties': {}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07f6995-c15b-4ebf-8631-c195db278fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07f6995-c15b-4ebf-8631-c195db278fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050f0e12-415b-4e53-8f6f-4a1038970d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Volume b09eaab6-9ae5-4a30-9dcd-5e56808cf07f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f', 'volume_size': 1, 'image_id': '7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1733860871', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c2695506c6240d6b003cff21251d7af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'created_at': datetime.datetime(2026, 11, 1, 8, 42, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 42, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1/file', 'properties': {}}, 'image_service': } Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Trying to clone b09eaab6-9ae5-4a30-9dcd-5e56808cf07f from image 7bf392c5-0676-4b62-8115-67d1aaa3c2e1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:42:13 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 1073741824" returned: 0 in 0.910s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:13 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 Nov 01 09:42:13 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-79010ad4-3cdd-47c2-9073-4fe9d04486dd req-4474f1d6-41a3-42f9-a4ee-3d37dc3a8409 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:13 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4" returned: 0 in 0.371s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-79010ad4-3cdd-47c2-9073-4fe9d04486dd req-4474f1d6-41a3-42f9-a4ee-3d37dc3a8409 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.258s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab764baf-f636-428d-9ff7-bf85297c5b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724e73ba-295a-482b-bb7b-98f054ba84f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-79010ad4-3cdd-47c2-9073-4fe9d04486dd req-4474f1d6-41a3-42f9-a4ee-3d37dc3a8409 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Volume volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 (ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4): created successfully Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (724e73ba-295a-482b-bb7b-98f054ba84f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Flow 'volume_create_manager' (5ee74b79-6d87-401a-b7f7-a9a5e5a1b362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:13 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bd9e9b5f-e17e-4c4d-82fe-3542e834225b tempest-TestInstancesWithCinderVolumes-103268201 None] Created volume successfully. Nov 01 09:42:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-79010ad4-3cdd-47c2-9073-4fe9d04486dd req-4474f1d6-41a3-42f9-a4ee-3d37dc3a8409 tempest-AttachVolumeNegativeTest-1317075963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7ff69c8-d3a4-4ce3-b4c2-b4cbab370033', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:42:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-79010ad4-3cdd-47c2-9073-4fe9d04486dd req-4474f1d6-41a3-42f9-a4ee-3d37dc3a8409 tempest-AttachVolumeNegativeTest-1317075963 None] attachment_update completed successfully. Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Flow 'volume_create_manager' (62226818-f7b1-42e2-8052-5d66b679c0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b814c4e-b3cf-464e-a046-b93a170d1fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b814c4e-b3cf-464e-a046-b93a170d1fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-126082340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af428a27-f1f4-4dc7-8ee3-88de9255d185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12684b9c39104d8da8440eb5a14c6327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:15Z,use_quota=True,user_id='05d1b809c05542b29602ce43abf8a223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bcee5a-4161-4bc7-a762-b79d3eca46a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bcee5a-4161-4bc7-a762-b79d3eca46a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1936b5e4-e249-400e-bd63-57071cb9701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1936b5e4-e249-400e-bd63-57071cb9701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af428a27-f1f4-4dc7-8ee3-88de9255d185', 'volume_name': 'volume-af428a27-f1f4-4dc7-8ee3-88de9255d185', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65773756-2ad2-424e-82ec-235795a1216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65773756-2ad2-424e-82ec-235795a1216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964f2e10-515c-4b6d-ac1e-f3e228a99e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:15 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Volume af428a27-f1f4-4dc7-8ee3-88de9255d185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af428a27-f1f4-4dc7-8ee3-88de9255d185', 'volume_size': 1} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-126082340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af428a27-f1f4-4dc7-8ee3-88de9255d185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12684b9c39104d8da8440eb5a14c6327',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:15Z,use_quota=True,user_id='05d1b809c05542b29602ce43abf8a223',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Creating volume af428a27-f1f4-4dc7-8ee3-88de9255d185 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:42:15 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:42:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:15 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 1073741824 Nov 01 09:42:15 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:16 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 1073741824" returned: 0 in 0.833s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:16 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 Nov 01 09:42:16 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:17 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185" returned: 0 in 0.589s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (964f2e10-515c-4b6d-ac1e-f3e228a99e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af428a27-f1f4-4dc7-8ee3-88de9255d185', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7101fca9-45d1-47ed-8c90-8cb6e116c64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:17 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Volume volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 (af428a27-f1f4-4dc7-8ee3-88de9255d185): created successfully Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7101fca9-45d1-47ed-8c90-8cb6e116c64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Flow 'volume_create_manager' (62226818-f7b1-42e2-8052-5d66b679c0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c0c5abf5-373b-4388-b4f0-0d1a2aa2a748 tempest-SnapshotMetadataTestJSON-2055048071 None] Created volume successfully. Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Creating offline snapshot c1ff937a-347c-4c2c-99f4-affcc3ddd576 of volume af428a27-f1f4-4dc7-8ee3-88de9255d185 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[79445b2c-57c8-46e2-bf44-49766f0d7c66]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:18 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 Nov 01 09:42:18 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:18 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185" returned: 0 in 0.684s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:18 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 1G Nov 01 09:42:18 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:19 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 1G" returned: 0 in 0.671s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:19 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 Nov 01 09:42:19 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:19 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576" returned: 0 in 0.403s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:19 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 is being set with open permissions: ugo+rw Nov 01 09:42:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:19 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 Nov 01 09:42:19 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:20 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576" returned: 0 in 0.451s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:20 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.info Nov 01 09:42:20 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD, size 20.69 MB, duration 7.36 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:42:20 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Image download 20.69 MB at 2.81 MB/s Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df5ed7c-b728-4cf4-949f-4be4c97e2884]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:20 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.info" returned: 0 in 0.384s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:20 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.info is being set with open permissions: ugo+rw Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:20 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD Nov 01 09:42:20 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:20 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.info Nov 01 09:42:20 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:20 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD" returned: 0 in 0.407s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:20 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Temporary image 7bf392c5-0676-4b62-8115-67d1aaa3c2e1 is fetched for user 108c50fd953d4620af28ce75daadef01. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:42:21 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.info" returned: 0 in 0.420s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.189s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5a305636-6f45-4cfd-8be3-b3da4079ecc3 tempest-SnapshotMetadataTestJSON-2055048071 None] Create snapshot completed successfully Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[65177904-a1c1-48f3-9f2d-0730b83335e5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:21 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD Nov 01 09:42:21 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:21 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1696778212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09eaab6-9ae5-4a30-9dcd-5e56808cf07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c2695506c6240d6b003cff21251d7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:12Z,use_quota=True,user_id='108c50fd953d4620af28ce75daadef01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc71e751-7724-4767-a6b5-b4a42de8845a),volume_type_id=bc71e751-7724-4767-a6b5-b4a42de8845a)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Creating volume b09eaab6-9ae5-4a30-9dcd-5e56808cf07f {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:42:21 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:42:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:21 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f 1073741824 Nov 01 09:42:21 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:22 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f 1073741824" returned: 0 in 0.593s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:22 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f Nov 01 09:42:22 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:22 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f" returned: 0 in 0.457s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:42:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:22 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Attempting download of 7bf392c5-0676-4b62-8115-67d1aaa3c2e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'metadata': {}}])) to volume b09eaab6-9ae5-4a30-9dcd-5e56808cf07f. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:42:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[402f64dc-6509-4654-9ad2-f30f1635dbc3]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bf392c5-0676-4b62-8115-67d1aaa3c2e1_ap0by1m2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:22 devstack sudo[97565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bf392c5-0676-4b62-8115-67d1aaa3c2e1_ap0by1m2 Nov 01 09:42:22 devstack sudo[97565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:23 devstack sudo[97565]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bf392c5-0676-4b62-8115-67d1aaa3c2e1_ap0by1m2" returned: 0 in 0.495s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf392c5-0676-4b62-8115-67d1aaa3c2e1_ap0by1m2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:23 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf392c5-0676-4b62-8115-67d1aaa3c2e1_ap0by1m2 Nov 01 09:42:23 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:23 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf392c5-0676-4b62-8115-67d1aaa3c2e1_ap0by1m2" returned: 1 in 0.540s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bf392c5-0676-4b62-8115-67d1aaa3c2e1_ap0by1m2' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[823009fe-f8bc-45f2-a6d0-9460fad01bfe]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "cinder-c1ff937a-347c-4c2c-99f4-affcc3ddd576-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-c1ff937a-347c-4c2c-99f4-affcc3ddd576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "cinder-quobyte-af428a27-f1f4-4dc7-8ee3-88de9255d185" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-quobyte-af428a27-f1f4-4dc7-8ee3-88de9255d185" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "cinder-quobyte-c1ff937a-347c-4c2c-99f4-affcc3ddd576" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-quobyte-c1ff937a-347c-4c2c-99f4-affcc3ddd576" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Deleting offline snapshot c1ff937a-347c-4c2c-99f4-affcc3ddd576 of volume af428a27-f1f4-4dc7-8ee3-88de9255d185 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] snapshot_file for this snap is: volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:42:24 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c3ed5-8846-4bad-a41c-b542dd4b58de]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:24 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:24 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD" returned: 0 in 0.541s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] 7bf392c5-0676-4b62-8115-67d1aaa3c2e1 was qcow2, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:42:24 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 Nov 01 09:42:24 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:24 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f Nov 01 09:42:24 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:24 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576" returned: 0 in 0.620s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af428a27-f1f4-4dc7-8ee3-88de9255d185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8819e49a-2818-42d0-8c67-e17c92dd640f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:24 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 Nov 01 09:42:24 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:25 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185" returned: 0 in 0.624s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:25 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 Nov 01 09:42:25 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:25 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576" returned: 0 in 0.453s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:25 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576 Nov 01 09:42:25 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:26 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185.c1ff937a-347c-4c2c-99f4-affcc3ddd576" returned: 0 in 0.467s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-quobyte-c1ff937a-347c-4c2c-99f4-affcc3ddd576" released by "_delete_snapshot" :: held 2.384s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-quobyte-af428a27-f1f4-4dc7-8ee3-88de9255d185" released by "delete_snapshot" :: held 2.442s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:26 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Created reservations ['1bfd3c4e-7c84-488f-a04f-3271360c1094', 'db0b4654-6ef1-4d70-bbdc-cd0eae5ec718', 'ed3da272-9e03-403a-b12f-7ce9c8aa8a57', '49fc3922-ee09-4ac8-9c3d-cee63e930b06'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:42:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Delete snapshot completed successfully. Nov 01 09:42:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-96003b4b-ddb7-436f-8086-4e66454e51f9 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-c1ff937a-347c-4c2c-99f4-affcc3ddd576-delete_snapshot" released by "delete_snapshot" :: held 2.732s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:26 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f" returned: 0 in 2.559s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7bf392c5-0676-4b62-8115-67d1aaa3c2e1__l3kf2jgdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:42:27 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Converted 112.00 MB image at 43.71 MB/s Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:27 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f 1G Nov 01 09:42:27 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "cinder-af428a27-f1f4-4dc7-8ee3-88de9255d185-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-af428a27-f1f4-4dc7-8ee3-88de9255d185-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "cinder-quobyte-af428a27-f1f4-4dc7-8ee3-88de9255d185" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-quobyte-af428a27-f1f4-4dc7-8ee3-88de9255d185" acquired by "delete_volume" :: waited 0.052s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9550fa3c-7a9f-452f-a4e8-680b31f12b0f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:27 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f 1G" returned: 0 in 0.968s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:27 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Downloaded image 7bf392c5-0676-4b62-8115-67d1aaa3c2e1 ((None, [{'url': 'file:///opt/stack/data/glance/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'metadata': {}}])) to volume b09eaab6-9ae5-4a30-9dcd-5e56808cf07f successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Temporary image 7bf392c5-0676-4b62-8115-67d1aaa3c2e1 for user 108c50fd953d4620af28ce75daadef01 is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Marking volume b09eaab6-9ae5-4a30-9dcd-5e56808cf07f as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Copying metadata from image 7bf392c5-0676-4b62-8115-67d1aaa3c2e1 to b09eaab6-9ae5-4a30-9dcd-5e56808cf07f. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Creating volume glance metadata for volume b09eaab6-9ae5-4a30-9dcd-5e56808cf07f backed by image 7bf392c5-0676-4b62-8115-67d1aaa3c2e1 with: {'image_id': '7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'image_name': 'tempest-scenario-img--1733860871', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:42:28 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 Nov 01 09:42:28 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050f0e12-415b-4e53-8f6f-4a1038970d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f', 'volume_size': 1, 'image_id': '7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1733860871', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9c2695506c6240d6b003cff21251d7af', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7bf392c5-0676-4b62-8115-67d1aaa3c2e1', 'created_at': datetime.datetime(2026, 11, 1, 8, 42, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 42, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bf392c5-0676-4b62-8115-67d1aaa3c2e1/file', 'properties': {}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6077645-bedc-46d5-b41b-6e95cbde9993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Volume volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f (b09eaab6-9ae5-4a30-9dcd-5e56808cf07f): created successfully Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6077645-bedc-46d5-b41b-6e95cbde9993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Flow 'volume_create_manager' (691255be-6477-4e3a-b06f-b7b72fcc9979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fcc1cc19-637e-4d48-a0b2-137e45f9079d tempest-TestInstancesWithCinderVolumes-103268201 None] Created volume successfully. Nov 01 09:42:28 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185" returned: 0 in 0.824s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:28 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185 Nov 01 09:42:28 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:28 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-af428a27-f1f4-4dc7-8ee3-88de9255d185" returned: 0 in 0.317s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-quobyte-af428a27-f1f4-4dc7-8ee3-88de9255d185" released by "delete_volume" :: held 1.311s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Created reservations ['f1be607f-0a50-4da8-b4de-e0c37b6e049f', '8aacbc15-413b-43ec-b670-2062bb1c97a7', '997457ec-04c9-4537-8c21-9eb8c3896f7f', 'a3cf216d-ee12-4188-8ee4-39b3aa7dfd5d'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:29 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:42:29 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:29 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.465s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:42:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Deleted volume successfully. Nov 01 09:42:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82cb37e9-9b03-4e4a-9983-76d3d1a84042 tempest-SnapshotMetadataTestJSON-2055048071 None] Lock "cinder-af428a27-f1f4-4dc7-8ee3-88de9255d185-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-3197db01-7527-48f1-b5af-97d1b2e2ea4e req-6fa35d17-e336-4886-8d69-528e95ed5986 tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-3197db01-7527-48f1-b5af-97d1b2e2ea4e req-6fa35d17-e336-4886-8d69-528e95ed5986 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-3197db01-7527-48f1-b5af-97d1b2e2ea4e req-6fa35d17-e336-4886-8d69-528e95ed5986 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-3197db01-7527-48f1-b5af-97d1b2e2ea4e req-6fa35d17-e336-4886-8d69-528e95ed5986 tempest-TestInstancesWithCinderVolumes-103268201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19fe434d-0b3d-4db1-8cd5-af1ae8757294', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:42:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-3197db01-7527-48f1-b5af-97d1b2e2ea4e req-6fa35d17-e336-4886-8d69-528e95ed5986 tempest-TestInstancesWithCinderVolumes-103268201 None] attachment_update completed successfully. Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Flow 'volume_create_manager' (5045eed3-b312-4ce2-b3eb-3ea42e1b0fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafd39ca-c456-4c2b-a7f4-cd1065b58c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafd39ca-c456-4c2b-a7f4-cd1065b58c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-885055451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a118f88-9f92-4780-856f-da67051dbf6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df087e4462429895f2ba129ef4a285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:37Z,use_quota=True,user_id='7ab43d8a40aa4733bca1e249df5a457a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957dccff-3aa6-4e5d-9ef1-36a496b0c8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957dccff-3aa6-4e5d-9ef1-36a496b0c8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25d3bb8-b8cf-4b50-a2b5-be65f0bb9c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25d3bb8-b8cf-4b50-a2b5-be65f0bb9c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a118f88-9f92-4780-856f-da67051dbf6f', 'volume_name': 'volume-6a118f88-9f92-4780-856f-da67051dbf6f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc57966-84e5-418b-928e-3eb9e6985dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc57966-84e5-418b-928e-3eb9e6985dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6993e4-2808-458b-b7bb-92f0c97e77af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:37 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Volume 6a118f88-9f92-4780-856f-da67051dbf6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a118f88-9f92-4780-856f-da67051dbf6f', 'volume_size': 1} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-885055451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a118f88-9f92-4780-856f-da67051dbf6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df087e4462429895f2ba129ef4a285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:37Z,use_quota=True,user_id='7ab43d8a40aa4733bca1e249df5a457a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Creating volume 6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:42:37 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:37 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f 1073741824 Nov 01 09:42:37 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:37 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f 1073741824" returned: 0 in 0.597s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:37 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f Nov 01 09:42:37 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:38 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f" returned: 0 in 0.478s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:42:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6993e4-2808-458b-b7bb-92f0c97e77af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a118f88-9f92-4780-856f-da67051dbf6f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc49708c-3839-475d-863c-f79953ed1a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:38 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Volume volume-6a118f88-9f92-4780-856f-da67051dbf6f (6a118f88-9f92-4780-856f-da67051dbf6f): created successfully Nov 01 09:42:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc49708c-3839-475d-863c-f79953ed1a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Flow 'volume_create_manager' (5045eed3-b312-4ce2-b3eb-3ea42e1b0fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-60ef03f0-09ca-4f3e-9068-dd67a970dec6 tempest-VolumesDeleteCascade-491383170 None] Created volume successfully. Nov 01 09:42:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Creating offline snapshot 511a8ab8-9bd5-4204-a0c4-306242749791 of volume 6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:42:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088ecd3-ea98-41e3-958a-1fe08b1a672e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:39 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f Nov 01 09:42:39 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:40 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f" returned: 0 in 0.446s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:40 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 1G Nov 01 09:42:40 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:40 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 1G" returned: 0 in 0.649s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:40 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 Nov 01 09:42:40 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:41 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791" returned: 0 in 0.337s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:41 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 is being set with open permissions: ugo+rw Nov 01 09:42:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:41 devstack sudo[97852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 Nov 01 09:42:41 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:41 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:41 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.info Nov 01 09:42:41 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:41 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.info" returned: 0 in 0.417s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:41 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.info is being set with open permissions: ugo+rw Nov 01 09:42:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:41 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.info Nov 01 09:42:41 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:42 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.info" returned: 0 in 0.368s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9eeb7c2f-b3ab-4653-a5be-5988788ec442 tempest-VolumesDeleteCascade-491383170 None] Create snapshot completed successfully Nov 01 09:42:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:43 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Creating offline snapshot b22847aa-94a9-414e-9b9d-474ee9611955 of volume 6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:42:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac370cb0-7dc4-4f89-9dd4-402b15d159e5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:43 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 Nov 01 09:42:43 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:44 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791" returned: 0 in 0.846s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a118f88-9f92-4780-856f-da67051dbf6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:42:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:44 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 1G Nov 01 09:42:44 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:45 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 1G" returned: 0 in 0.643s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:45 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 Nov 01 09:42:45 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:45 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955" returned: 0 in 0.683s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:45 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 is being set with open permissions: ugo+rw Nov 01 09:42:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:45 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 Nov 01 09:42:45 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:46 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955" returned: 0 in 0.393s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8e91a524-5ea4-4413-bbdd-1d50173435ef tempest-VolumesDeleteCascade-491383170 None] Create snapshot completed successfully Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-6a118f88-9f92-4780-856f-da67051dbf6f-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-6a118f88-9f92-4780-856f-da67051dbf6f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Performing cascade delete. {{(pid=86594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-511a8ab8-9bd5-4204-a0c4-306242749791-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-511a8ab8-9bd5-4204-a0c4-306242749791-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-511a8ab8-9bd5-4204-a0c4-306242749791" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-511a8ab8-9bd5-4204-a0c4-306242749791" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Deleting offline snapshot 511a8ab8-9bd5-4204-a0c4-306242749791 of volume 6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] snapshot_file for this snap is: volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac25dfed-e392-4f35-9332-af71d31cbf5c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:47 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 Nov 01 09:42:47 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:47 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791" returned: 0 in 0.455s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a118f88-9f92-4780-856f-da67051dbf6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:42:47 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e07de7-f501-4136-99be-045fca484ac4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:47 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f Nov 01 09:42:47 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:47 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f" returned: 0 in 0.496s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ca8b40-5a56-4c62-ac01-ab5b1fd4f72f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:48 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 Nov 01 09:42:48 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:48 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955" returned: 0 in 0.468s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a118f88-9f92-4780-856f-da67051dbf6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84689be-edd3-480f-8674-4a503a6fb373]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:48 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 Nov 01 09:42:48 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:48 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791" returned: 0 in 0.375s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a118f88-9f92-4780-856f-da67051dbf6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8812d57-5f85-48f2-b6c0-6938818b8621]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:49 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f Nov 01 09:42:49 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:49 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f" returned: 0 in 0.432s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:49 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 Nov 01 09:42:49 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:49 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791" returned: 0 in 0.483s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:49 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791 Nov 01 09:42:49 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:50 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.511a8ab8-9bd5-4204-a0c4-306242749791" returned: 0 in 0.276s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 -F qcow2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:50 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 -F qcow2 Nov 01 09:42:50 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:50 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a118f88-9f92-4780-856f-da67051dbf6f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 -F qcow2" returned: 0 in 0.285s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-511a8ab8-9bd5-4204-a0c4-306242749791" released by "_delete_snapshot" :: held 3.504s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" released by "delete_snapshot" :: held 3.531s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Created reservations ['4f76e82d-89e2-4453-907a-d1d3e7342324', '3c6731a7-21fb-43d6-b22e-d21699a68e65', '99fccbc9-00d6-4c2c-8e64-79f1b73ee381', '7e07ecc8-d563-46b9-8522-edb71fef43f3'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:42:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Delete snapshot completed successfully. Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-511a8ab8-9bd5-4204-a0c4-306242749791-delete_snapshot" released by "delete_snapshot" :: held 3.699s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-b22847aa-94a9-414e-9b9d-474ee9611955-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-b22847aa-94a9-414e-9b9d-474ee9611955-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-b22847aa-94a9-414e-9b9d-474ee9611955" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-b22847aa-94a9-414e-9b9d-474ee9611955" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Deleting offline snapshot b22847aa-94a9-414e-9b9d-474ee9611955 of volume 6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] snapshot_file for this snap is: volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9c5cb9-b1cd-4e63-81fa-9fabbe49dac1]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:50 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 Nov 01 09:42:50 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:51 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955" returned: 0 in 0.374s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a118f88-9f92-4780-856f-da67051dbf6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:42:51 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[586e00b1-1b93-4663-b77f-a7fbf526d469]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:51 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f Nov 01 09:42:51 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:51 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f" returned: 0 in 0.374s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:51 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 Nov 01 09:42:51 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:51 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955" returned: 0 in 0.380s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:51 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955 Nov 01 09:42:51 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:52 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f.b22847aa-94a9-414e-9b9d-474ee9611955" returned: 0 in 0.277s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-b22847aa-94a9-414e-9b9d-474ee9611955" released by "_delete_snapshot" :: held 1.527s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" released by "delete_snapshot" :: held 1.552s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Created reservations ['4072ea27-4456-4be9-9a71-b2a0cb0f3105', 'c9581aa2-21af-4476-948c-9b391ea04f09', '9c95ead9-46fe-4518-9196-41d9042bd4d3', 'b8588810-a851-47cc-9b27-92b832f46915'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:42:52 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Delete snapshot completed successfully. Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-b22847aa-94a9-414e-9b9d-474ee9611955-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Snapshots deleted, issuing volume delete {{(pid=86594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef84ada3-33b1-4987-b74c-fa6330ff6dd7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:52 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f Nov 01 09:42:52 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:52 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f" returned: 0 in 0.409s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:52 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f Nov 01 09:42:52 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:53 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6a118f88-9f92-4780-856f-da67051dbf6f" returned: 0 in 0.265s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6a118f88-9f92-4780-856f-da67051dbf6f" released by "delete_volume" :: held 0.741s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Created reservations ['cc73383c-5766-4b78-90a9-cad63cc01a3a', 'db984476-5ea5-43e9-af7f-90b5e04100ab', '00f879cb-bca9-4ce3-b997-5929db0820a8', '0f92c048-e82c-42a6-8fac-54a237021199'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:53 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:42:53 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:42:53 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:53 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:53 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.405s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:42:53 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Deleted volume successfully. Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c8907556-91fc-4eee-a901-565e3f2325a2 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-6a118f88-9f92-4780-856f-da67051dbf6f-delete_volume" released by "delete_volume" :: held 6.954s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:42:53 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.436s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:42:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Flow 'volume_create_manager' (02ec29b9-223b-4f42-829d-866c95fe3908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbfcdce-e964-429f-b4d8-bbf96e482d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fbfcdce-e964-429f-b4d8-bbf96e482d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-196156245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b48bd89-3175-4b78-a906-dc7bef59daa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df087e4462429895f2ba129ef4a285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:54Z,use_quota=True,user_id='7ab43d8a40aa4733bca1e249df5a457a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b36ddf-9f4a-48c7-b6e1-33739e5b6b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b36ddf-9f4a-48c7-b6e1-33739e5b6b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93f4bb9-91ad-4932-8735-8fd4a122e1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a93f4bb9-91ad-4932-8735-8fd4a122e1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b48bd89-3175-4b78-a906-dc7bef59daa2', 'volume_name': 'volume-6b48bd89-3175-4b78-a906-dc7bef59daa2', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60959b3c-104b-4125-aa13-e3e1c02836ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60959b3c-104b-4125-aa13-e3e1c02836ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8634ee85-75f1-447f-bbb4-ed929837f5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:54 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Volume 6b48bd89-3175-4b78-a906-dc7bef59daa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b48bd89-3175-4b78-a906-dc7bef59daa2', 'volume_size': 1} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-196156245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b48bd89-3175-4b78-a906-dc7bef59daa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df087e4462429895f2ba129ef4a285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:42:54Z,use_quota=True,user_id='7ab43d8a40aa4733bca1e249df5a457a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Creating volume 6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:42:54 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:54 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 1073741824 Nov 01 09:42:54 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:54 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 1073741824" returned: 0 in 0.407s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:54 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 Nov 01 09:42:54 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:55 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8634ee85-75f1-447f-bbb4-ed929837f5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b48bd89-3175-4b78-a906-dc7bef59daa2', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6891f8f-8ddb-4ea3-8df5-0dec641f1901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:55 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Volume volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 (6b48bd89-3175-4b78-a906-dc7bef59daa2): created successfully Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6891f8f-8ddb-4ea3-8df5-0dec641f1901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Flow 'volume_create_manager' (02ec29b9-223b-4f42-829d-866c95fe3908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e066add1-cd8d-499c-a1e1-b8eacd309dc1 tempest-VolumesDeleteCascade-491383170 None] Created volume successfully. Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Creating offline snapshot 8616371a-e01f-415f-8f37-8f61722562bb of volume 6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a86320-8257-4b3c-b296-dd49458f21be]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:42:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:55 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 Nov 01 09:42:55 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:55 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2" returned: 0 in 0.455s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:56 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb 1G Nov 01 09:42:56 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:56 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb 1G" returned: 0 in 0.868s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:56 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb Nov 01 09:42:56 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:57 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb" returned: 0 in 0.400s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:57 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb is being set with open permissions: ugo+rw Nov 01 09:42:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:57 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb Nov 01 09:42:57 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:57 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb" returned: 0 in 0.348s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:57 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.info Nov 01 09:42:57 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:58 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.info" returned: 0 in 0.416s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:58 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.info is being set with open permissions: ugo+rw Nov 01 09:42:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:42:58 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.info Nov 01 09:42:58 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:42:58 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Nov 01 09:42:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.info" returned: 0 in 0.376s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:42:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c0cf1643-ef4b-4cbf-be6e-4566b40daaaf tempest-VolumesDeleteCascade-491383170 None] Create snapshot completed successfully Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Flow 'volume_create_manager' (1246a0d7-e342-48eb-b9db-6039004633b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3edd4d1-4f97-4646-a7a7-72f3316d8246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=80,cinder:UPDATE=65,cinder:DELETE=9,cinder:INSERT=19 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3edd4d1-4f97-4646-a7a7-72f3316d8246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-498703252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a212aa4-9ae0-41ab-aa4b-e592279ed85b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30df087e4462429895f2ba129ef4a285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8616371a-e01f-415f-8f37-8f61722562bb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:00Z,use_quota=True,user_id='7ab43d8a40aa4733bca1e249df5a457a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164c4408-123a-4cfe-8213-80e6add3bfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164c4408-123a-4cfe-8213-80e6add3bfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2709df8-6c0d-481e-99b6-b35a756d5b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2709df8-6c0d-481e-99b6-b35a756d5b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a212aa4-9ae0-41ab-aa4b-e592279ed85b', 'volume_name': 'volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b', 'volume_size': 1, 'snapshot_id': '8616371a-e01f-415f-8f37-8f61722562bb'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201aae34-79b9-4de4-bf17-4435d1d5ba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201aae34-79b9-4de4-bf17-4435d1d5ba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d574a8-5da0-4950-9556-0d025c1e0000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:42:59 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Volume 3a212aa4-9ae0-41ab-aa4b-e592279ed85b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b', 'volume_size': 1, 'snapshot_id': '8616371a-e01f-415f-8f37-8f61722562bb'} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-8616371a-e01f-415f-8f37-8f61722562bb-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-8616371a-e01f-415f-8f37-8f61722562bb-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Creating volume 3a212aa4-9ae0-41ab-aa4b-e592279ed85b from snapshot 8616371a-e01f-415f-8f37-8f61722562bb {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:42:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] snapshot: 8616371a-e01f-415f-8f37-8f61722562bb, volume: 3a212aa4-9ae0-41ab-aa4b-e592279ed85b, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d954a18-1f57-4b8f-a4ae-d26ebcbd6936]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:00 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb Nov 01 09:43:00 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:00 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb" returned: 0 in 0.398s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b48bd89-3175-4b78-a906-dc7bef59daa2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bfd5fa-439a-4af3-8fb5-e9b475f04033]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:00 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-373e4125-4302-428c-8875-d95304ec5dce req-755b23f2-aba8-47d7-88f0-3429bcd8303f tempest-TestShelveInstance-1738689165 None] Terminate volume connection completed successfully. Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-373e4125-4302-428c-8875-d95304ec5dce req-755b23f2-aba8-47d7-88f0-3429bcd8303f tempest-TestShelveInstance-1738689165 None] Deleting attachment 46edc01b-ed32-49cd-bdbb-586f7d0d9bd9. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:43:00 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 Nov 01 09:43:00 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Acquiring lock "cinder-813972db-2aa4-4808-9924-79788cefc791-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Lock "cinder-813972db-2aa4-4808-9924-79788cefc791-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Acquiring lock "cinder-quobyte-813972db-2aa4-4808-9924-79788cefc791" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Lock "cinder-quobyte-813972db-2aa4-4808-9924-79788cefc791" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2583d9-7b5e-484c-b359-ad7764dd7353]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:00 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2" returned: 0 in 0.426s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:43:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:00 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b Nov 01 09:43:00 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:01 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 Nov 01 09:43:01 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:01 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791" returned: 0 in 0.535s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:01 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791 Nov 01 09:43:01 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:01 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-813972db-2aa4-4808-9924-79788cefc791" returned: 0 in 0.473s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Lock "cinder-quobyte-813972db-2aa4-4808-9924-79788cefc791" released by "delete_volume" :: held 1.086s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG cinder.quota [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Created reservations ['752e65b3-de70-44b8-9e16-669fb8e4afed', 'afff1a4b-9ce9-4cfe-a67f-4fa0c924c6b3', 'd009bea2-eb50-495f-9c2c-d6704b902d71', 'be647027-dc26-4e6e-827e-b6e0946cd06a'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:02 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:02 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:02 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.679s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:02 devstack cinder-volume[86594]: DEBUG cinder.manager [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:02 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Deleted volume successfully. Nov 01 09:43:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [req-373e4125-4302-428c-8875-d95304ec5dce req-de639f18-7543-4a58-bb66-9232f68e097c tempest-TestShelveInstance-1738689165 None] Lock "cinder-813972db-2aa4-4808-9924-79788cefc791-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:03 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-df528fd7-572a-4b66-8205-ab49cf734480 req-be8ba0d4-b592-444b-b729-96575e2b6134 tempest-AttachVolumeNegativeTest-1317075963 None] Terminate volume connection completed successfully. Nov 01 09:43:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-df528fd7-572a-4b66-8205-ab49cf734480 req-be8ba0d4-b592-444b-b729-96575e2b6134 tempest-AttachVolumeNegativeTest-1317075963 None] Deleting attachment b7ff69c8-d3a4-4ce3-b4c2-b4cbab370033. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:43:11 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" returned: 0 in 10.135s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2, size 1024.00 MB, duration 10.14 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:43:11 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Converted 1024.00 MB image at 101.03 MB/s Nov 01 09:43:11 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b is being set with open permissions: ugo+rw Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:11 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b Nov 01 09:43:11 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=91,cinder:UPDATE=77,cinder:INSERT=22,cinder:DELETE=4 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1e9c8a6e-ed56-4b0d-abf3-adbae22f27ce req-f487e5b6-cef2-4156-a070-3d8b91e27e0d tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:11 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" released by "_copy_volume_from_snapshot" :: held 11.374s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-8616371a-e01f-415f-8f37-8f61722562bb-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" released by "_create_volume_from_snapshot" :: held 11.463s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.488s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1e9c8a6e-ed56-4b0d-abf3-adbae22f27ce req-f487e5b6-cef2-4156-a070-3d8b91e27e0d tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.147s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1e9c8a6e-ed56-4b0d-abf3-adbae22f27ce req-f487e5b6-cef2-4156-a070-3d8b91e27e0d tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d574a8-5da0-4950-9556-0d025c1e0000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b', 'volume_size': 1, 'snapshot_id': '8616371a-e01f-415f-8f37-8f61722562bb'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf27aac-95b8-4c64-ac39-0f9db8aa6c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:11 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Volume volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b (3a212aa4-9ae0-41ab-aa4b-e592279ed85b): created successfully Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf27aac-95b8-4c64-ac39-0f9db8aa6c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Flow 'volume_create_manager' (1246a0d7-e342-48eb-b9db-6039004633b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-1e9c8a6e-ed56-4b0d-abf3-adbae22f27ce req-f487e5b6-cef2-4156-a070-3d8b91e27e0d tempest-TestInstancesWithCinderVolumes-103268201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-ce575831-a8c0-4523-b24c-e831cdb17b42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b089796-28a7-469e-9857-c8ff775b0fcd', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:43:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6d82ffae-0cfd-4e55-a5e1-c155f7edeffb tempest-VolumesDeleteCascade-491383170 None] Created volume successfully. Nov 01 09:43:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-1e9c8a6e-ed56-4b0d-abf3-adbae22f27ce req-f487e5b6-cef2-4156-a070-3d8b91e27e0d tempest-TestInstancesWithCinderVolumes-103268201 None] attachment_update completed successfully. Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-6b48bd89-3175-4b78-a906-dc7bef59daa2-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-6b48bd89-3175-4b78-a906-dc7bef59daa2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Performing cascade delete. {{(pid=86594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-8616371a-e01f-415f-8f37-8f61722562bb-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-8616371a-e01f-415f-8f37-8f61722562bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-6b48bd89-3175-4b78-a906-dc7bef59daa2" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6b48bd89-3175-4b78-a906-dc7bef59daa2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-8616371a-e01f-415f-8f37-8f61722562bb" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-8616371a-e01f-415f-8f37-8f61722562bb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Deleting offline snapshot 8616371a-e01f-415f-8f37-8f61722562bb of volume 6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] snapshot_file for this snap is: volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d73b22-24ea-41c3-8de8-74a076c9472e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:12 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb Nov 01 09:43:12 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:13 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb" returned: 0 in 0.468s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b48bd89-3175-4b78-a906-dc7bef59daa2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:43:13 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14101cb-42a2-42ce-a6ec-c34a2f275c32]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:13 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 Nov 01 09:43:13 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:13 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2" returned: 0 in 0.676s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:13 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb Nov 01 09:43:13 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:14 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb" returned: 0 in 0.587s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:14 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb Nov 01 09:43:14 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:14 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2.8616371a-e01f-415f-8f37-8f61722562bb" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-8616371a-e01f-415f-8f37-8f61722562bb" released by "_delete_snapshot" :: held 2.230s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6b48bd89-3175-4b78-a906-dc7bef59daa2" released by "delete_snapshot" :: held 2.268s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-f5ea1a42-e84e-4c91-8b81-4a93808f7832 req-d40411ed-70bc-4c46-aded-7e877accfde0 tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-f5ea1a42-e84e-4c91-8b81-4a93808f7832 req-d40411ed-70bc-4c46-aded-7e877accfde0 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-f5ea1a42-e84e-4c91-8b81-4a93808f7832 req-d40411ed-70bc-4c46-aded-7e877accfde0 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-f5ea1a42-e84e-4c91-8b81-4a93808f7832 req-d40411ed-70bc-4c46-aded-7e877accfde0 tempest-TestInstancesWithCinderVolumes-103268201 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3744f8e5-57f5-4c86-94f0-d9be88a6c453', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Created reservations ['f32bedb3-6312-4a23-88f6-e75d8d02dfcb', 'b6204c3d-f959-4850-8a56-00633cbc4668', '5817fe08-be99-41bf-94d3-9eb7710f046e', 'cbf6f6d7-8ca6-4c16-9403-0942dc26d5f8'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-f5ea1a42-e84e-4c91-8b81-4a93808f7832 req-d40411ed-70bc-4c46-aded-7e877accfde0 tempest-TestInstancesWithCinderVolumes-103268201 None] attachment_update completed successfully. Nov 01 09:43:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Delete snapshot completed successfully. Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-8616371a-e01f-415f-8f37-8f61722562bb-delete_snapshot" released by "delete_snapshot" :: held 2.548s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Snapshots deleted, issuing volume delete {{(pid=86594) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-6b48bd89-3175-4b78-a906-dc7bef59daa2" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6b48bd89-3175-4b78-a906-dc7bef59daa2" acquired by "delete_volume" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0601bc-7c81-4612-85a3-c5954199a92b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:15 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 Nov 01 09:43:15 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:15 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2" returned: 0 in 0.503s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:15 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2 Nov 01 09:43:15 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:16 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b48bd89-3175-4b78-a906-dc7bef59daa2" returned: 0 in 0.342s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-6b48bd89-3175-4b78-a906-dc7bef59daa2" released by "delete_volume" :: held 0.955s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Created reservations ['587591aa-8bf2-48d2-8422-4c5c0ff9a626', 'a41330fb-2853-4e5c-b76d-16be3ff65c79', 'c06dff82-b806-4914-95b8-71e837a48b3c', 'a1b45f36-4617-43c4-90a2-ad924946e2c0'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:16 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:16 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:16 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.307s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Deleted volume successfully. Nov 01 09:43:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-292f1f6f-cd52-4944-b9d0-be2de19d86eb tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-6b48bd89-3175-4b78-a906-dc7bef59daa2-delete_volume" released by "delete_volume" :: held 4.126s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-3a212aa4-9ae0-41ab-aa4b-e592279ed85b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-3a212aa4-9ae0-41ab-aa4b-e592279ed85b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "cinder-quobyte-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" acquired by "delete_volume" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7e0375-cdca-4ba4-b699-e98df3c016e2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:17 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b Nov 01 09:43:17 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:17 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" returned: 0 in 0.557s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:17 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b Nov 01 09:43:17 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:18 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" returned: 0 in 0.404s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-quobyte-3a212aa4-9ae0-41ab-aa4b-e592279ed85b" released by "delete_volume" :: held 1.034s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Created reservations ['44947f1e-e939-4c18-9fb3-966704e1cd2f', 'bd902139-df0a-490e-9e80-0c3aef9070dc', 'ed76e269-afa0-44aa-a693-f72b55fd7eec', '82970dba-eee9-4514-a5e8-1b6d0a3c9262'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:18 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:18 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:18 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.315s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Deleted volume successfully. Nov 01 09:43:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-23ee0f16-a4d2-41a2-81e8-fce91d014e06 tempest-VolumesDeleteCascade-491383170 None] Lock "cinder-3a212aa4-9ae0-41ab-aa4b-e592279ed85b-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-9206ce1a-5e64-498c-a51d-f1f9eac2d38d req-b9e8b9b3-1f68-4333-adac-c3c4252ee9b0 tempest-TestInstancesWithCinderVolumes-103268201 None] Terminate volume connection completed successfully. Nov 01 09:43:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-9206ce1a-5e64-498c-a51d-f1f9eac2d38d req-b9e8b9b3-1f68-4333-adac-c3c4252ee9b0 tempest-TestInstancesWithCinderVolumes-103268201 None] Deleting attachment 9b089796-28a7-469e-9857-c8ff775b0fcd. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:43:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "cinder-ce575831-a8c0-4523-b24c-e831cdb17b42-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-ce575831-a8c0-4523-b24c-e831cdb17b42-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "cinder-quobyte-ce575831-a8c0-4523-b24c-e831cdb17b42" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-quobyte-ce575831-a8c0-4523-b24c-e831cdb17b42" acquired by "delete_volume" :: waited 0.040s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ef3945-b265-4658-9727-038774e1e46d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:23 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 Nov 01 09:43:23 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:23 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42" returned: 0 in 0.812s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:23 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42 Nov 01 09:43:23 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:24 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce575831-a8c0-4523-b24c-e831cdb17b42" returned: 0 in 0.626s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-quobyte-ce575831-a8c0-4523-b24c-e831cdb17b42" released by "delete_volume" :: held 1.556s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:24 devstack cinder-volume[86594]: WARNING cinder.quota [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1140517152-680133415 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1140517152-680133415, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:43:24 devstack cinder-volume[86594]: WARNING cinder.quota [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1140517152-680133415 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1140517152-680133415, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Created reservations ['40cd613f-8222-41af-baac-b1ac8c93d3c6', '9138831e-c0bd-4a4a-87b3-af5df059aaef', '65f74664-0ba4-4be6-a865-809dea7acfa5', '4de48f81-3945-4917-8ff7-89397617f313'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:24 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:24 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:25 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.572s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:25 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Deleted volume successfully. Nov 01 09:43:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0b1b4429-5e42-44f9-8745-47a85ec6d94e tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-ce575831-a8c0-4523-b24c-e831cdb17b42-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-4be3d0b7-2e1f-4d4d-90af-6db7b4bd4a8c req-7a15152a-e615-454a-b2b6-1f4c718921f7 tempest-TestInstancesWithCinderVolumes-103268201 None] Terminate volume connection completed successfully. Nov 01 09:43:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4be3d0b7-2e1f-4d4d-90af-6db7b4bd4a8c req-7a15152a-e615-454a-b2b6-1f4c718921f7 tempest-TestInstancesWithCinderVolumes-103268201 None] Deleting attachment 3744f8e5-57f5-4c86-94f0-d9be88a6c453. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:43:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "cinder-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "cinder-quobyte-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-quobyte-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4" acquired by "delete_volume" :: waited 0.040s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:29 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[455e8700-2ef1-4c68-8be8-15dfc13d3674]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:29 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 Nov 01 09:43:29 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:30 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Flow 'volume_create_manager' (815e1d71-422b-4ab6-803e-85d0bc58b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d039c0-2cc4-4d62-9a62-181cde64c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4" returned: 0 in 0.701s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:30 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4 Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d039c0-2cc4-4d62-9a62-181cde64c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1864513976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a74a469-b746-4b67-a2b0-0772c9a43735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0f2b65d9684d6aa6618c4a1df04770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:30Z,use_quota=True,user_id='d50632313a33403ab6bef73ec28d801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:30 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f70d710-b54d-46be-ad7b-4ffaad8c2f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f70d710-b54d-46be-ad7b-4ffaad8c2f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814aa33e-9004-4491-ae86-c47e0f485413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814aa33e-9004-4491-ae86-c47e0f485413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a74a469-b746-4b67-a2b0-0772c9a43735', 'volume_name': 'volume-8a74a469-b746-4b67-a2b0-0772c9a43735', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0241c7e-552f-4afd-892d-6f072472908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0241c7e-552f-4afd-892d-6f072472908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dd95ec-a343-44b6-8c08-7b80f8f715f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Volume 8a74a469-b746-4b67-a2b0-0772c9a43735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a74a469-b746-4b67-a2b0-0772c9a43735', 'volume_size': 1} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1864513976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a74a469-b746-4b67-a2b0-0772c9a43735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0f2b65d9684d6aa6618c4a1df04770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:30Z,use_quota=True,user_id='d50632313a33403ab6bef73ec28d801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Creating volume 8a74a469-b746-4b67-a2b0-0772c9a43735 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:43:30 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:30 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 1073741824 Nov 01 09:43:30 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:30 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4" returned: 0 in 0.341s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-quobyte-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4" released by "delete_volume" :: held 1.135s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:30 devstack cinder-volume[86594]: WARNING cinder.quota [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1157758318-1146273285 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1157758318-1146273285, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:43:30 devstack cinder-volume[86594]: WARNING cinder.quota [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1157758318-1146273285 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1157758318-1146273285, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Created reservations ['30797d7f-f70f-4e88-ac0e-4a83dc22d472', '7f7054d7-ee2d-413c-bcfc-8a978f6ab92e', '20ccdee8-f5e0-4eb5-904a-45450f343a8f', 'efd40159-ac59-4315-a24b-9cecfaaf405f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:30 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:30 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:30 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 1073741824" returned: 0 in 0.663s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:31 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 Nov 01 09:43:31 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:31 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.450s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Deleted volume successfully. Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6486f8b1-d74a-4566-b8a2-d74f1b0a278a tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-ccbfe98b-ca6c-4210-9ae6-8a5279bb3ea4-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:31 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735" returned: 0 in 0.512s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dd95ec-a343-44b6-8c08-7b80f8f715f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a74a469-b746-4b67-a2b0-0772c9a43735', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e0cb41-4bd9-4c9e-8e84-65b1b8babf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:31 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Volume volume-8a74a469-b746-4b67-a2b0-0772c9a43735 (8a74a469-b746-4b67-a2b0-0772c9a43735): created successfully Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e0cb41-4bd9-4c9e-8e84-65b1b8babf72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Flow 'volume_create_manager' (815e1d71-422b-4ab6-803e-85d0bc58b703) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5080865d-2795-494a-ae21-090d6b036145 tempest-VolumesTransfersV355Test-1495572495 None] Created volume successfully. Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Flow 'volume_create_manager' (36e3aa95-f09d-49c7-b023-fd18aa9cae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa9c253-95ce-486a-b337-89c96a74b37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aa9c253-95ce-486a-b337-89c96a74b37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fec2ef-0c1d-461c-956d-d404a870723b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c3791b02184233b8df847dd2e4d0f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:32Z,use_quota=True,user_id='a8116655d3ba4e309df2f43022eb50d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9413b7ec-dc81-4420-96fe-c481076e6df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9413b7ec-dc81-4420-96fe-c481076e6df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee8f8f4-f320-469f-b942-bfe05a06ae1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:31 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:43:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee8f8f4-f320-469f-b942-bfe05a06ae1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9fec2ef-0c1d-461c-956d-d404a870723b', 'volume_name': 'volume-d9fec2ef-0c1d-461c-956d-d404a870723b', 'volume_size': 1, 'image_id': '56adf1fc-f61c-406f-abb9-7860a01ce176', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56adf1fc-f61c-406f-abb9-7860a01ce176', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b8c02dff3264d0830057a14ca423eec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '24c3791b02184233b8df847dd2e4d0f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd18edce655557b3d0d1e14c64dc7bbbe4c687be79590cf943a9227275222ff77b6ca7f6c83716cac2c6df0a28bb4d83d5ad9cb7cddf4589c6a92a2e9a33b9ec8', 'id': '56adf1fc-f61c-406f-abb9-7860a01ce176', 'created_at': datetime.datetime(2026, 11, 1, 8, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56adf1fc-f61c-406f-abb9-7860a01ce176/file', 'properties': {}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aad4b31-98b0-4365-96d9-2fd98f14880d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aad4b31-98b0-4365-96d9-2fd98f14880d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15deb19-907a-47bc-a0a6-e04e206fc2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:32 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Volume d9fec2ef-0c1d-461c-956d-d404a870723b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9fec2ef-0c1d-461c-956d-d404a870723b', 'volume_size': 1, 'image_id': '56adf1fc-f61c-406f-abb9-7860a01ce176', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56adf1fc-f61c-406f-abb9-7860a01ce176', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b8c02dff3264d0830057a14ca423eec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '24c3791b02184233b8df847dd2e4d0f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd18edce655557b3d0d1e14c64dc7bbbe4c687be79590cf943a9227275222ff77b6ca7f6c83716cac2c6df0a28bb4d83d5ad9cb7cddf4589c6a92a2e9a33b9ec8', 'id': '56adf1fc-f61c-406f-abb9-7860a01ce176', 'created_at': datetime.datetime(2026, 11, 1, 8, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56adf1fc-f61c-406f-abb9-7860a01ce176/file', 'properties': {}}, 'image_service': } Nov 01 09:43:32 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Trying to clone d9fec2ef-0c1d-461c-956d-d404a870723b from image 56adf1fc-f61c-406f-abb9-7860a01ce176 at location (None, [{'url': 'file:///opt/stack/data/glance/images/56adf1fc-f61c-406f-abb9-7860a01ce176', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:43:32 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:43:32 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Image download 0.00 MB at 0.00 MB/s Nov 01 09:43:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a7a3d-7fe4-4006-9790-57a21b69de25]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:32 devstack sudo[98464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD Nov 01 09:43:32 devstack sudo[98464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:33 devstack sudo[98464]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:33 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD Nov 01 09:43:33 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d5cf565c-44e4-4b70-9db7-9e6a81a05b6f tempest-VolumesTransfersV355Test-1100474452 None] Transfer volume completed successfully. Nov 01 09:43:33 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD" returned: 1 in 0.586s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:43:33 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Temporary image 56adf1fc-f61c-406f-abb9-7860a01ce176 is fetched for user a8116655d3ba4e309df2f43022eb50d6. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:43:33 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8accadc-b930-4be7-89d6-9f799e92aed1]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:33 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD Nov 01 09:43:33 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:34 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD" returned: 0 in 0.772s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:34 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD Nov 01 09:43:34 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Acquiring lock "cinder-8a74a469-b746-4b67-a2b0-0772c9a43735-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Lock "cinder-8a74a469-b746-4b67-a2b0-0772c9a43735-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Acquiring lock "cinder-quobyte-8a74a469-b746-4b67-a2b0-0772c9a43735" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Lock "cinder-quobyte-8a74a469-b746-4b67-a2b0-0772c9a43735" acquired by "delete_volume" :: waited 0.046s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e44d3d-2a00-4144-b4da-ccbfc1e7fd31]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:35 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD" returned: 1 in 0.800s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fec2ef-0c1d-461c-956d-d404a870723b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24c3791b02184233b8df847dd2e4d0f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:32Z,use_quota=True,user_id='a8116655d3ba4e309df2f43022eb50d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Creating volume d9fec2ef-0c1d-461c-956d-d404a870723b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:43:35 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:35 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 Nov 01 09:43:35 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:35 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b 1073741824 Nov 01 09:43:35 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:35 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735" returned: 0 in 0.718s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:35 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735 Nov 01 09:43:35 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:36 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b 1073741824" returned: 0 in 0.768s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:36 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b Nov 01 09:43:36 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:36 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8a74a469-b746-4b67-a2b0-0772c9a43735" returned: 0 in 0.473s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Lock "cinder-quobyte-8a74a469-b746-4b67-a2b0-0772c9a43735" released by "delete_volume" :: held 1.306s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Created reservations ['624e32b7-97a4-4f33-a3d4-8a4bec27ee4f', 'c6e85731-15c9-4652-aa05-f64549de9d92', '1ea2b1d5-2104-485b-97ce-320d70015890', 'fe83fca1-00ab-4b14-abc5-c22c1dcb143f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-d5206d72-b5cc-43e1-b30d-a6da492384e6 req-c50fa4e4-dea9-4fa3-8d93-02cd13a4de27 tempest-TestInstancesWithCinderVolumes-103268201 None] Terminate volume connection completed successfully. Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-d5206d72-b5cc-43e1-b30d-a6da492384e6 req-c50fa4e4-dea9-4fa3-8d93-02cd13a4de27 tempest-TestInstancesWithCinderVolumes-103268201 None] Deleting attachment 19fe434d-0b3d-4db1-8cd5-af1ae8757294. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:36 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b" returned: 0 in 0.347s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:36 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:36 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Attempting download of 56adf1fc-f61c-406f-abb9-7860a01ce176 ((None, [{'url': 'file:///opt/stack/data/glance/images/56adf1fc-f61c-406f-abb9-7860a01ce176', 'metadata': {}}])) to volume d9fec2ef-0c1d-461c-956d-d404a870723b. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdeb35d-1352-49a1-ac40-9f089bd524a7]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56adf1fc-f61c-406f-abb9-7860a01ce176_s6edzcmy {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:36 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56adf1fc-f61c-406f-abb9-7860a01ce176_s6edzcmy Nov 01 09:43:36 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:36 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.319s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Deleted volume successfully. Nov 01 09:43:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a4e45175-2fad-493f-9f02-cf3056ee8f05 tempest-VolumesTransfersV355Test-2083073900 None] Lock "cinder-8a74a469-b746-4b67-a2b0-0772c9a43735-delete_volume" released by "delete_volume" :: held 2.014s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:37 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_56adf1fc-f61c-406f-abb9-7860a01ce176_s6edzcmy" returned: 0 in 0.371s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56adf1fc-f61c-406f-abb9-7860a01ce176_s6edzcmy {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:37 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56adf1fc-f61c-406f-abb9-7860a01ce176_s6edzcmy Nov 01 09:43:37 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:37 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56adf1fc-f61c-406f-abb9-7860a01ce176_s6edzcmy" returned: 1 in 0.394s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_56adf1fc-f61c-406f-abb9-7860a01ce176_s6edzcmy' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5725dd-f05d-4418-8bea-8bf5be981c7f]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:37 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD Nov 01 09:43:37 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Flow 'volume_create_manager' (d7f90f2d-f1cc-4a36-be86-c4a292a7dfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:37 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc78bf99-50ac-4ac8-a6f0-b38fbe537990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc78bf99-50ac-4ac8-a6f0-b38fbe537990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1817116695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3d5e0a-c469-4b9d-b599-a75b17d46a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0f2b65d9684d6aa6618c4a1df04770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:38Z,use_quota=True,user_id='d50632313a33403ab6bef73ec28d801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0ee330-d7ab-4f3d-a1aa-e63273f5f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0ee330-d7ab-4f3d-a1aa-e63273f5f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af43ce5-d865-4436-860f-7d760913756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af43ce5-d865-4436-860f-7d760913756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e3d5e0a-c469-4b9d-b599-a75b17d46a19', 'volume_name': 'volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca4567-6073-4005-9ce7-bee8ee4e6f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dca4567-6073-4005-9ce7-bee8ee4e6f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c9c24e-3862-42c3-8ad1-b79b8aca29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:37 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Volume 3e3d5e0a-c469-4b9d-b599-a75b17d46a19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19', 'volume_size': 1} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1817116695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e3d5e0a-c469-4b9d-b599-a75b17d46a19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f0f2b65d9684d6aa6618c4a1df04770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:38Z,use_quota=True,user_id='d50632313a33403ab6bef73ec28d801f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Creating volume 3e3d5e0a-c469-4b9d-b599-a75b17d46a19 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:43:37 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:43:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:37 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 1073741824 Nov 01 09:43:37 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:37 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD Nov 01 09:43:37 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "cinder-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "cinder-quobyte-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-quobyte-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[980d4717-4bd6-457c-869c-57d41dc165bd]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:38 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] 56adf1fc-f61c-406f-abb9-7860a01ce176 was raw, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:38 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b Nov 01 09:43:38 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:38 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f Nov 01 09:43:38 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:38 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 1073741824" returned: 0 in 0.560s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:38 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 Nov 01 09:43:38 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:38 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f" returned: 0 in 0.453s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:38 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f Nov 01 09:43:38 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:38 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:38 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b" returned: 0 in 0.577s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_56adf1fc-f61c-406f-abb9-7860a01ce176_sbsx6zocdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:43:38 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19" returned: 0 in 0.294s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:38 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b 1G Nov 01 09:43:38 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c9c24e-3862-42c3-8ad1-b79b8aca29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b885fdf1-3394-4a4c-973d-d988f50cf04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:38 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Volume volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 (3e3d5e0a-c469-4b9d-b599-a75b17d46a19): created successfully Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b885fdf1-3394-4a4c-973d-d988f50cf04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Flow 'volume_create_manager' (d7f90f2d-f1cc-4a36-be86-c4a292a7dfd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-02e44806-7f0c-430e-9b75-f40d97d6f803 tempest-VolumesTransfersV355Test-1495572495 None] Created volume successfully. Nov 01 09:43:38 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-quobyte-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f" released by "delete_volume" :: held 0.796s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:38 devstack cinder-volume[86594]: WARNING cinder.quota [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1450024548-2085920421 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1450024548-2085920421, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:43:38 devstack cinder-volume[86594]: WARNING cinder.quota [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1450024548-2085920421 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1450024548-2085920421, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:43:38 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Created reservations ['edc0f730-81be-4d9d-a0fb-fc5ed68112f8', '028bbdd1-f63b-4dd3-830c-8bc287717415', 'a3b0e5d8-8924-4b8c-b22d-f47cd9870dd0', '403de495-d1b8-4311-b062-012389845297'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:39 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:39 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:39 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b 1G" returned: 0 in 0.342s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Downloaded image 56adf1fc-f61c-406f-abb9-7860a01ce176 ((None, [{'url': 'file:///opt/stack/data/glance/images/56adf1fc-f61c-406f-abb9-7860a01ce176', 'metadata': {}}])) to volume d9fec2ef-0c1d-461c-956d-d404a870723b successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Temporary image 56adf1fc-f61c-406f-abb9-7860a01ce176 for user a8116655d3ba4e309df2f43022eb50d6 is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Marking volume d9fec2ef-0c1d-461c-956d-d404a870723b as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Copying metadata from image 56adf1fc-f61c-406f-abb9-7860a01ce176 to d9fec2ef-0c1d-461c-956d-d404a870723b. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Creating volume glance metadata for volume d9fec2ef-0c1d-461c-956d-d404a870723b backed by image 56adf1fc-f61c-406f-abb9-7860a01ce176 with: {'image_id': '56adf1fc-f61c-406f-abb9-7860a01ce176', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1b8c02dff3264d0830057a14ca423eec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15deb19-907a-47bc-a0a6-e04e206fc2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9fec2ef-0c1d-461c-956d-d404a870723b', 'volume_size': 1, 'image_id': '56adf1fc-f61c-406f-abb9-7860a01ce176', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/56adf1fc-f61c-406f-abb9-7860a01ce176', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1b8c02dff3264d0830057a14ca423eec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '24c3791b02184233b8df847dd2e4d0f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd18edce655557b3d0d1e14c64dc7bbbe4c687be79590cf943a9227275222ff77b6ca7f6c83716cac2c6df0a28bb4d83d5ad9cb7cddf4589c6a92a2e9a33b9ec8', 'id': '56adf1fc-f61c-406f-abb9-7860a01ce176', 'created_at': datetime.datetime(2026, 11, 1, 8, 43, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 43, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/56adf1fc-f61c-406f-abb9-7860a01ce176/file', 'properties': {}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48061513-95c1-4556-8ba1-a59b36bd052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:39 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Volume volume-d9fec2ef-0c1d-461c-956d-d404a870723b (d9fec2ef-0c1d-461c-956d-d404a870723b): created successfully Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48061513-95c1-4556-8ba1-a59b36bd052c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Flow 'volume_create_manager' (36e3aa95-f09d-49c7-b023-fd18aa9cae8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-93a1e039-d0fb-4b6a-912c-f8e1b3e52912 tempest-VolumeImageDependencyTests-2113480371 None] Created volume successfully. Nov 01 09:43:39 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.267s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Deleted volume successfully. Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f0b29049-4a3c-4bc3-9777-9bf1677e9122 tempest-TestInstancesWithCinderVolumes-103268201 None] Lock "cinder-b09eaab6-9ae5-4a30-9dcd-5e56808cf07f-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Acquiring lock "cinder-d9fec2ef-0c1d-461c-956d-d404a870723b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Lock "cinder-d9fec2ef-0c1d-461c-956d-d404a870723b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Acquiring lock "cinder-quobyte-d9fec2ef-0c1d-461c-956d-d404a870723b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Lock "cinder-quobyte-d9fec2ef-0c1d-461c-956d-d404a870723b" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6879175-c3c4-48c7-bd7d-3dbd1f3872d0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:39 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b Nov 01 09:43:39 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:40 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Acquiring lock "cinder-3e3d5e0a-c469-4b9d-b599-a75b17d46a19-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b" returned: 0 in 0.438s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Lock "cinder-3e3d5e0a-c469-4b9d-b599-a75b17d46a19-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:40 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b Nov 01 09:43:40 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Acquiring lock "cinder-quobyte-3e3d5e0a-c469-4b9d-b599-a75b17d46a19" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Lock "cinder-quobyte-3e3d5e0a-c469-4b9d-b599-a75b17d46a19" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[784b53bb-4317-46e5-b639-5e11ac00f834]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:40 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 Nov 01 09:43:40 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:40 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d9fec2ef-0c1d-461c-956d-d404a870723b" returned: 0 in 0.276s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Lock "cinder-quobyte-d9fec2ef-0c1d-461c-956d-d404a870723b" released by "delete_volume" :: held 0.781s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Created reservations ['e703b4fc-c09c-468c-b598-6a30c7044019', '8696fb0b-9289-45e4-852a-37ca0d1adcd7', '4baf8775-8abc-4cd3-9cbd-3d76b218054a', '69415713-b402-42ec-8b65-54ecc4d5ca06'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:40 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:40 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:40 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19" returned: 0 in 0.431s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:40 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19 Nov 01 09:43:40 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:40 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:40 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:40 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Deleted volume successfully. Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a40a2870-4aed-4c83-ab8a-ef4e88f28940 tempest-VolumeImageDependencyTests-2113480371 None] Lock "cinder-d9fec2ef-0c1d-461c-956d-d404a870723b-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:41 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3e3d5e0a-c469-4b9d-b599-a75b17d46a19" returned: 0 in 0.348s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Lock "cinder-quobyte-3e3d5e0a-c469-4b9d-b599-a75b17d46a19" released by "delete_volume" :: held 0.847s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Created reservations ['f5bf6f6a-916a-44f7-85b8-ddc844660135', 'd28ec092-f586-45fd-bd7b-d54f39a85981', '24b863b3-951d-4594-8dcd-7daceebae54d', 'af11033e-3ccb-4689-99c1-344948d67b64'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:41 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:41 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:41 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.326s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Deleted volume successfully. Nov 01 09:43:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-827f5ff8-cdff-4a44-aba9-c9a2aa1e81d5 tempest-VolumesTransfersV355Test-2083073900 None] Lock "cinder-3e3d5e0a-c469-4b9d-b599-a75b17d46a19-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Flow 'volume_create_manager' (eaa56ea9-0787-43f4-9a56-551a95ecf861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265e094b-d591-41e5-b0d5-af966abbfe62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265e094b-d591-41e5-b0d5-af966abbfe62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1242967897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03d94c1-10c5-4346-b84d-f41501cbfa2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a9df778b4b418785f28d399d4f8b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:46Z,use_quota=True,user_id='4f7f4217d33c45eca24965acd842ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d06de4-4d05-4773-880d-fef01520f11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d06de4-4d05-4773-880d-fef01520f11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959e493c-2024-482e-8f2b-72e0549003e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959e493c-2024-482e-8f2b-72e0549003e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03d94c1-10c5-4346-b84d-f41501cbfa2d', 'volume_name': 'volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c1c301-8167-44aa-b032-3e220487a28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c1c301-8167-44aa-b032-3e220487a28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce45cb7-b22c-431c-a6f3-1a25a790468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:46 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Volume a03d94c1-10c5-4346-b84d-f41501cbfa2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d', 'volume_size': 1} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1242967897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03d94c1-10c5-4346-b84d-f41501cbfa2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a9df778b4b418785f28d399d4f8b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:46Z,use_quota=True,user_id='4f7f4217d33c45eca24965acd842ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Creating volume a03d94c1-10c5-4346-b84d-f41501cbfa2d {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:43:46 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:43:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:46 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d 1073741824 Nov 01 09:43:46 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:47 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d 1073741824" returned: 0 in 0.775s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:47 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d Nov 01 09:43:47 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:47 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d" returned: 0 in 0.309s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ce45cb7-b22c-431c-a6f3-1a25a790468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4aeee6-4362-4f7b-a5d4-c67543a8e27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:47 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Volume volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d (a03d94c1-10c5-4346-b84d-f41501cbfa2d): created successfully Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f4aeee6-4362-4f7b-a5d4-c67543a8e27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Flow 'volume_create_manager' (eaa56ea9-0787-43f4-9a56-551a95ecf861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:47 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ccece486-24c0-4877-b041-781c4619bbc0 tempest-ProjectReaderTests-894036196 None] Created volume successfully. Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Flow 'volume_create_manager' (ba24cd52-1db2-431d-a7c8-66ce77b6b0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4cbbfd-faf4-45a9-8bd2-13afcd1cc3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4cbbfd-faf4-45a9-8bd2-13afcd1cc3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-609590672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d76696-af65-4b51-bae1-2723d1c7c77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b10a866ca74796b00731bbdb648f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:48Z,use_quota=True,user_id='de97136f5d304a968e5883bbd023c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfa1a94-7895-4a7e-884e-40d2b1fcb73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfa1a94-7895-4a7e-884e-40d2b1fcb73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82096df0-b444-4a15-aaea-d8a0ef997932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82096df0-b444-4a15-aaea-d8a0ef997932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d76696-af65-4b51-bae1-2723d1c7c77b', 'volume_name': 'volume-a6d76696-af65-4b51-bae1-2723d1c7c77b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c1eb37-137d-4972-ad36-903821e6967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c1eb37-137d-4972-ad36-903821e6967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db707b60-113f-4ceb-9e99-61ad7a8dcf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:48 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Volume a6d76696-af65-4b51-bae1-2723d1c7c77b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d76696-af65-4b51-bae1-2723d1c7c77b', 'volume_size': 1} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-609590672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d76696-af65-4b51-bae1-2723d1c7c77b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b10a866ca74796b00731bbdb648f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:48Z,use_quota=True,user_id='de97136f5d304a968e5883bbd023c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Creating volume a6d76696-af65-4b51-bae1-2723d1c7c77b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:43:48 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:48 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b 1073741824 Nov 01 09:43:48 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Acquiring lock "cinder-a03d94c1-10c5-4346-b84d-f41501cbfa2d-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Lock "cinder-a03d94c1-10c5-4346-b84d-f41501cbfa2d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Acquiring lock "cinder-quobyte-a03d94c1-10c5-4346-b84d-f41501cbfa2d" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Lock "cinder-quobyte-a03d94c1-10c5-4346-b84d-f41501cbfa2d" acquired by "delete_volume" :: waited 0.031s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:48 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b 1073741824" returned: 0 in 0.603s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce2094-5f2f-4350-ab33-000b43492c5c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:48 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b Nov 01 09:43:48 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:48 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d Nov 01 09:43:48 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:49 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b" returned: 0 in 0.359s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db707b60-113f-4ceb-9e99-61ad7a8dcf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d76696-af65-4b51-bae1-2723d1c7c77b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba31487-d34d-4972-a2e8-0f62c4b07afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:49 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Volume volume-a6d76696-af65-4b51-bae1-2723d1c7c77b (a6d76696-af65-4b51-bae1-2723d1c7c77b): created successfully Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba31487-d34d-4972-a2e8-0f62c4b07afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Flow 'volume_create_manager' (ba24cd52-1db2-431d-a7c8-66ce77b6b0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5082516d-21fc-4371-9116-7d4a148c20fd tempest-AttachVolumeNegativeTest-1317075963 None] Created volume successfully. Nov 01 09:43:49 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d" returned: 0 in 0.523s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:49 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d Nov 01 09:43:49 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:49 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a03d94c1-10c5-4346-b84d-f41501cbfa2d" returned: 0 in 0.253s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Lock "cinder-quobyte-a03d94c1-10c5-4346-b84d-f41501cbfa2d" released by "delete_volume" :: held 0.841s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Created reservations ['e16c0590-40e6-47b1-b2a1-1453bf7bf7d7', 'c3b0a442-9fcd-4a01-8db0-3ac2bc788159', 'f36164cf-fd87-4fec-b6ef-cc156134659e', '9f0303da-c51a-44c6-88ff-9ea857f52597'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:49 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:49 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:50 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.462s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Deleted volume successfully. Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-dbff10bb-3013-418e-9be4-ba8e59515a40 tempest-ProjectReaderTests-894036196 None] Lock "cinder-a03d94c1-10c5-4346-b84d-f41501cbfa2d-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Flow 'volume_create_manager' (d858dfba-7b2c-4dba-8852-c54502d9d4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aecf792-eab0-4043-802d-521ccaa647ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aecf792-eab0-4043-802d-521ccaa647ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-404982947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d205872-4b56-41aa-95b1-c0ae7196b421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a652931811404fdfa958bef0412426c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:50Z,use_quota=True,user_id='4c3c5cc30dda40699f4cc562f6aefded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f152b60-7807-43c4-a77d-05c0dca91b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f152b60-7807-43c4-a77d-05c0dca91b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d27007-1661-4dd2-a558-3a4b569a9e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62d27007-1661-4dd2-a558-3a4b569a9e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d205872-4b56-41aa-95b1-c0ae7196b421', 'volume_name': 'volume-3d205872-4b56-41aa-95b1-c0ae7196b421', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf41aa3d-d784-4461-8bd6-5b20a88e1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf41aa3d-d784-4461-8bd6-5b20a88e1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb528a78-ade4-40bf-bc8c-12c20fe5155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Volume 3d205872-4b56-41aa-95b1-c0ae7196b421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d205872-4b56-41aa-95b1-c0ae7196b421', 'volume_size': 1} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-404982947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d205872-4b56-41aa-95b1-c0ae7196b421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a652931811404fdfa958bef0412426c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:50Z,use_quota=True,user_id='4c3c5cc30dda40699f4cc562f6aefded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Creating volume 3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:43:50 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:50 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 1073741824 Nov 01 09:43:50 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Flow 'volume_create_manager' (933d3a6b-96ea-4edd-9a4a-c8614465e80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ed310b-db15-4709-a565-1317925cfea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ed310b-db15-4709-a565-1317925cfea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094654491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c703a3-9192-4f49-b9c1-e402452876bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a9df778b4b418785f28d399d4f8b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:51Z,use_quota=True,user_id='4f7f4217d33c45eca24965acd842ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3d3e4a-6c0e-4cd6-9faa-942bbc783b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3d3e4a-6c0e-4cd6-9faa-942bbc783b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798b91fe-b3cd-4fe0-90f5-211359669ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798b91fe-b3cd-4fe0-90f5-211359669ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1c703a3-9192-4f49-b9c1-e402452876bb', 'volume_name': 'volume-a1c703a3-9192-4f49-b9c1-e402452876bb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60aacc8-12a7-4670-ac60-e94215f617f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c60aacc8-12a7-4670-ac60-e94215f617f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba834c8d-4001-428e-8984-c84ab49811ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:50 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Volume a1c703a3-9192-4f49-b9c1-e402452876bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1c703a3-9192-4f49-b9c1-e402452876bb', 'volume_size': 1} Nov 01 09:43:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6c9492c4-949c-48be-b088-d6b2aaa700fa req-ac3c152e-a45e-433c-a790-3c5524a495b6 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:51 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 1073741824" returned: 0 in 0.602s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:51 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 Nov 01 09:43:51 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:51 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421" returned: 0 in 0.281s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094654491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1c703a3-9192-4f49-b9c1-e402452876bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a9df778b4b418785f28d399d4f8b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:51Z,use_quota=True,user_id='4f7f4217d33c45eca24965acd842ac39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Creating volume a1c703a3-9192-4f49-b9c1-e402452876bb {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:43:51 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:51 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb 1073741824 Nov 01 09:43:51 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb528a78-ade4-40bf-bc8c-12c20fe5155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d205872-4b56-41aa-95b1-c0ae7196b421', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05204511-c98a-46ed-b648-a507be55e032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:51 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Volume volume-3d205872-4b56-41aa-95b1-c0ae7196b421 (3d205872-4b56-41aa-95b1-c0ae7196b421): created successfully Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05204511-c98a-46ed-b648-a507be55e032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Flow 'volume_create_manager' (d858dfba-7b2c-4dba-8852-c54502d9d4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-cd70b960-caa3-4654-9350-6d6af3adb4d5 tempest-VolumesCloneTest-15181976 None] Created volume successfully. Nov 01 09:43:52 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb 1073741824" returned: 0 in 0.476s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:52 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb Nov 01 09:43:52 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:52 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb" returned: 0 in 0.322s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6c9492c4-949c-48be-b088-d6b2aaa700fa req-ac3c152e-a45e-433c-a790-3c5524a495b6 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.335s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba834c8d-4001-428e-8984-c84ab49811ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1c703a3-9192-4f49-b9c1-e402452876bb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd68c82b-7d33-41ba-a10b-deb986276094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6c9492c4-949c-48be-b088-d6b2aaa700fa req-ac3c152e-a45e-433c-a790-3c5524a495b6 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:52 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Volume volume-a1c703a3-9192-4f49-b9c1-e402452876bb (a1c703a3-9192-4f49-b9c1-e402452876bb): created successfully Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd68c82b-7d33-41ba-a10b-deb986276094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Flow 'volume_create_manager' (933d3a6b-96ea-4edd-9a4a-c8614465e80c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:52 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-05c96bcf-c6b7-47a1-ae13-a10d8006011f tempest-ProjectReaderTests-894036196 None] Created volume successfully. Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-6c9492c4-949c-48be-b088-d6b2aaa700fa req-ac3c152e-a45e-433c-a790-3c5524a495b6 tempest-AttachVolumeNegativeTest-1317075963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-a6d76696-af65-4b51-bae1-2723d1c7c77b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a7ce5a7-da2e-4f48-a86a-193a43ec1e3b', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:43:52 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-6c9492c4-949c-48be-b088-d6b2aaa700fa req-ac3c152e-a45e-433c-a790-3c5524a495b6 tempest-AttachVolumeNegativeTest-1317075963 None] attachment_update completed successfully. Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Acquiring lock "cinder-a1c703a3-9192-4f49-b9c1-e402452876bb-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Lock "cinder-a1c703a3-9192-4f49-b9c1-e402452876bb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Acquiring lock "cinder-quobyte-a1c703a3-9192-4f49-b9c1-e402452876bb" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Lock "cinder-quobyte-a1c703a3-9192-4f49-b9c1-e402452876bb" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed0246-7b67-4dae-a8b2-961672d1b1f0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Flow 'volume_create_manager' (86d70a6a-fde3-4748-83da-c2fad181604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada9eff3-3560-4c35-bca0-895a5b36f673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:53 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb Nov 01 09:43:53 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada9eff3-3560-4c35-bca0-895a5b36f673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1396576636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4086ce5-3290-4b03-9d3d-c30e939499fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a652931811404fdfa958bef0412426c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:43:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3d205872-4b56-41aa-95b1-c0ae7196b421,status='creating',terminated_at=None,updated_at=2026-11-01T08:43:53Z,use_quota=True,user_id='4c3c5cc30dda40699f4cc562f6aefded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4882a109-8328-4ca8-b08c-1debefad3ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4882a109-8328-4ca8-b08c-1debefad3ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987dd601-5056-46cb-92fe-47db55c32a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987dd601-5056-46cb-92fe-47db55c32a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd4086ce5-3290-4b03-9d3d-c30e939499fa', 'volume_name': 'volume-d4086ce5-3290-4b03-9d3d-c30e939499fa', 'volume_size': 2, 'source_volid': '3d205872-4b56-41aa-95b1-c0ae7196b421', 'source_volstatus': 'available'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7f48a4-12e2-4bae-9bbb-d000c5ac5b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7f48a4-12e2-4bae-9bbb-d000c5ac5b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd772aef-a8b6-433b-9235-e93d3e0e2684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:43:53 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Volume d4086ce5-3290-4b03-9d3d-c30e939499fa: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d4086ce5-3290-4b03-9d3d-c30e939499fa', 'volume_size': 2, 'source_volid': '3d205872-4b56-41aa-95b1-c0ae7196b421', 'source_volstatus': 'available'} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:53 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Cloning volume 3d205872-4b56-41aa-95b1-c0ae7196b421 to volume d4086ce5-3290-4b03-9d3d-c30e939499fa Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Creating offline snapshot 7363269d-5441-474e-8dac-d74004436357 of volume 3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc12b76-eb41-408b-bb52-eafe4caf74f7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:53 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:53 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:53 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb" returned: 0 in 0.486s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:53 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 Nov 01 09:43:53 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:53 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb Nov 01 09:43:53 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:53 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.402s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:43:53 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a1c703a3-9192-4f49-b9c1-e402452876bb" returned: 0 in 0.345s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Lock "cinder-quobyte-a1c703a3-9192-4f49-b9c1-e402452876bb" released by "delete_volume" :: held 0.898s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Created reservations ['ea018ad3-0242-4072-aa4c-509b54bfc213', 'a66e63c3-8930-4e10-98f9-ed09b338a4ca', '2d480d1c-e030-4045-b566-9dbc5e5abfe9', '1e7df98a-77bc-4633-a62f-bf1830b2dfef'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:43:53 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421" returned: 0 in 0.597s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:54 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 1G Nov 01 09:43:54 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:54 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:43:54 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:54 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.289s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:43:54 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Deleted volume successfully. Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9b6f5533-c83e-451a-b203-b8c60250b4eb tempest-ProjectReaderTests-894036196 None] Lock "cinder-a1c703a3-9192-4f49-b9c1-e402452876bb-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:43:54 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 1G" returned: 0 in 0.561s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d205872-4b56-41aa-95b1-c0ae7196b421 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:54 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d205872-4b56-41aa-95b1-c0ae7196b421 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 Nov 01 09:43:54 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:54 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d205872-4b56-41aa-95b1-c0ae7196b421 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357" returned: 0 in 0.359s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:54 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 is being set with open permissions: ugo+rw Nov 01 09:43:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:54 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 Nov 01 09:43:54 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-e882aee3-7b0d-42ab-a249-9f1199c1c151 req-6c7135e7-ac64-40df-aa32-c557c0872ef1 tempest-AttachVolumeNegativeTest-1317075963 None] Terminate volume connection completed successfully. Nov 01 09:43:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-e882aee3-7b0d-42ab-a249-9f1199c1c151 req-6c7135e7-ac64-40df-aa32-c557c0872ef1 tempest-AttachVolumeNegativeTest-1317075963 None] Deleting attachment 3a7ce5a7-da2e-4f48-a86a-193a43ec1e3b. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:43:55 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357" returned: 0 in 0.312s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:55 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.info Nov 01 09:43:55 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:55 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.info" returned: 0 in 0.349s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:55 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.info is being set with open permissions: ugo+rw Nov 01 09:43:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:55 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.info Nov 01 09:43:55 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:56 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.info" returned: 0 in 0.417s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Acquiring lock "cinder-quobyte-d4086ce5-3290-4b03-9d3d-c30e939499fa" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Lock "cinder-quobyte-d4086ce5-3290-4b03-9d3d-c30e939499fa" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] snapshot: 7363269d-5441-474e-8dac-d74004436357, volume: d4086ce5-3290-4b03-9d3d-c30e939499fa, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6a74c3-1442-43b7-bc4a-5a1dfee52d7a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:56 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 Nov 01 09:43:56 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:56 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357" returned: 0 in 0.603s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d205872-4b56-41aa-95b1-c0ae7196b421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c22080-5f6a-4765-b24e-cc6220533d06]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:43:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:56 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 Nov 01 09:43:56 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:43:57 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Nov 01 09:43:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421" returned: 0 in 0.440s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:43:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:43:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:43:57 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:43:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:43:57 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa Nov 01 09:43:57 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:05 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=104,cinder:INSERT=27,cinder:UPDATE=120,cinder:DELETE=11 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:44:05 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=111,cinder:UPDATE=118,cinder:INSERT=38,cinder:DELETE=8 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:44:07 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa" returned: 0 in 9.929s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421, size 1024.00 MB, duration 9.93 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:44:07 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Converted 1024.00 MB image at 103.12 MB/s Nov 01 09:44:07 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa is being set with open permissions: ugo+rw Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:07 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa Nov 01 09:44:07 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:07 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa" returned: 0 in 0.312s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Lock "cinder-quobyte-d4086ce5-3290-4b03-9d3d-c30e939499fa" released by "_copy_volume_from_snapshot" :: held 11.422s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Acquiring lock "cinder-quobyte-7363269d-5441-474e-8dac-d74004436357" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Lock "cinder-quobyte-7363269d-5441-474e-8dac-d74004436357" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Deleting offline snapshot 7363269d-5441-474e-8dac-d74004436357 of volume 3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] snapshot_file for this snap is: volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[128875c6-f3e9-4420-937e-bdcddc2c4126]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:07 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 Nov 01 09:44:07 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:08 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357" returned: 0 in 0.478s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d205872-4b56-41aa-95b1-c0ae7196b421(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:44:08 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1d99aa-c851-4cf8-bb6d-1c533939ecf0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:08 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 Nov 01 09:44:08 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:08 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421" returned: 0 in 0.602s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:08 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 Nov 01 09:44:08 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:09 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357" returned: 0 in 0.412s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:09 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357 Nov 01 09:44:09 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:09 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421.7363269d-5441-474e-8dac-d74004436357" returned: 0 in 0.322s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Lock "cinder-quobyte-7363269d-5441-474e-8dac-d74004436357" released by "_delete_snapshot" :: held 1.965s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.373s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd772aef-a8b6-433b-9235-e93d3e0e2684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4086ce5-3290-4b03-9d3d-c30e939499fa', 'volume_size': 2, 'source_volid': '3d205872-4b56-41aa-95b1-c0ae7196b421', 'source_volstatus': 'available'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b98b5cc-2dec-4c3c-b5fb-a3de3de71b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Volume volume-d4086ce5-3290-4b03-9d3d-c30e939499fa (d4086ce5-3290-4b03-9d3d-c30e939499fa): created successfully Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b98b5cc-2dec-4c3c-b5fb-a3de3de71b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Flow 'volume_create_manager' (86d70a6a-fde3-4748-83da-c2fad181604d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7faf07a3-f16c-48de-9981-30d493892bd7 tempest-VolumesCloneTest-15181976 None] Created volume successfully. Nov 01 09:44:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Acquiring lock "cinder-d4086ce5-3290-4b03-9d3d-c30e939499fa-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Lock "cinder-d4086ce5-3290-4b03-9d3d-c30e939499fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Acquiring lock "cinder-quobyte-d4086ce5-3290-4b03-9d3d-c30e939499fa" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Lock "cinder-quobyte-d4086ce5-3290-4b03-9d3d-c30e939499fa" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:11 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a55e5-9c52-414d-be9d-5bc1a513060f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:11 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa Nov 01 09:44:11 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:12 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa" returned: 0 in 0.602s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:12 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa Nov 01 09:44:12 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:12 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d4086ce5-3290-4b03-9d3d-c30e939499fa" returned: 0 in 0.328s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Lock "cinder-quobyte-d4086ce5-3290-4b03-9d3d-c30e939499fa" released by "delete_volume" :: held 1.002s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Created reservations ['0c997e06-7444-47eb-a251-859c0974b8aa', '5c2d1487-bae2-4e81-8c14-125a63a628b5', '28310b46-6a30-49f7-add3-8a38c45f22d6', '89ba9251-8fa0-4e50-b167-05ffea85a45e'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:12 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:44:12 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:12 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.352s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:12 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:44:12 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Deleted volume successfully. Nov 01 09:44:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3fa4a3f8-0c30-4545-99de-948a81db05c1 tempest-VolumesCloneTest-15181976 None] Lock "cinder-d4086ce5-3290-4b03-9d3d-c30e939499fa-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Acquiring lock "cinder-3d205872-4b56-41aa-95b1-c0ae7196b421-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Lock "cinder-3d205872-4b56-41aa-95b1-c0ae7196b421-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Acquiring lock "cinder-quobyte-3d205872-4b56-41aa-95b1-c0ae7196b421" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Lock "cinder-quobyte-3d205872-4b56-41aa-95b1-c0ae7196b421" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:13 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4acb20-aead-4930-b8d5-b417a1cdc768]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:14 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 Nov 01 09:44:14 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:14 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421" returned: 0 in 0.582s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:14 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421 Nov 01 09:44:14 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:14 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d205872-4b56-41aa-95b1-c0ae7196b421" returned: 0 in 0.297s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Lock "cinder-quobyte-3d205872-4b56-41aa-95b1-c0ae7196b421" released by "delete_volume" :: held 1.003s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Created reservations ['09098b3c-bd96-4195-9d58-21b6e8046fd4', '73497642-c6be-4528-accc-ec908311087a', '69e17341-f450-4c27-84bb-7eed625d0638', '8bff635c-9294-44d4-80fc-0d8e982d098a'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:15 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:44:15 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:15 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.293s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:15 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:44:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Deleted volume successfully. Nov 01 09:44:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c67dee7f-448a-48aa-b233-66dfffffe01b tempest-VolumesCloneTest-15181976 None] Lock "cinder-3d205872-4b56-41aa-95b1-c0ae7196b421-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:21 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:44:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Flow 'volume_create_manager' (7273b264-4427-4344-af10-ba36b150c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25328a3-5b85-4fa8-8e57-76886c74d777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25328a3-5b85-4fa8-8e57-76886c74d777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1801660245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9646b5c1-2b0c-4675-afb4-e5fdd4da41ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54df663f69d44d1b250a1eecbec6532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:21Z,use_quota=True,user_id='188a12a18dea4cffa8c615bf95cb1cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990c22be-8440-4b20-ba58-afb45a5a21cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990c22be-8440-4b20-ba58-afb45a5a21cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700d9c84-0dd9-4892-b916-f2ff2f619414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:21 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:44:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (700d9c84-0dd9-4892-b916-f2ff2f619414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9646b5c1-2b0c-4675-afb4-e5fdd4da41ee', 'volume_name': 'volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaebe4e8-46f8-41e5-91ac-750865f82f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaebe4e8-46f8-41e5-91ac-750865f82f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f01529-7773-46f5-874c-6c6c1fea96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:22 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Volume 9646b5c1-2b0c-4675-afb4-e5fdd4da41ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 09:44:22 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Trying to clone 9646b5c1-2b0c-4675-afb4-e5fdd4da41ee from image c507ec59-c87f-4d5c-be6c-eab60d7c916d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:44:22 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:44:22 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Image download 20.69 MB at 20.69 MB/s Nov 01 09:44:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b3ad0e-f9d9-4072-b144-de93366b7817]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:22 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD Nov 01 09:44:22 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:23 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d is fetched for user 188a12a18dea4cffa8c615bf95cb1cae. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3891a431-9d97-4b8c-b311-a6ecb9029227]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:23 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD Nov 01 09:44:23 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:23 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD" returned: 0 in 0.542s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1801660245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9646b5c1-2b0c-4675-afb4-e5fdd4da41ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54df663f69d44d1b250a1eecbec6532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:21Z,use_quota=True,user_id='188a12a18dea4cffa8c615bf95cb1cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Creating volume 9646b5c1-2b0c-4675-afb4-e5fdd4da41ee {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:44:23 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:44:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:23 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee 1073741824 Nov 01 09:44:23 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:24 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee 1073741824" returned: 0 in 0.681s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:24 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee Nov 01 09:44:24 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:24 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee" returned: 0 in 0.357s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:44:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Attempting download of c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 9646b5c1-2b0c-4675-afb4-e5fdd4da41ee. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[deabc1e0-1132-471f-b8d9-df6561a52772]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_n4j1q86b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:25 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_n4j1q86b Nov 01 09:44:25 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:25 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_n4j1q86b" returned: 0 in 0.435s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_n4j1q86b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:25 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_n4j1q86b Nov 01 09:44:25 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:25 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_n4j1q86b" returned: 1 in 0.391s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_n4j1q86b' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ade67b-3bf1-4975-9b5b-55daf99af17a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:26 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD Nov 01 09:44:26 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:26 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD" returned: 0 in 0.552s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:26 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] c507ec59-c87f-4d5c-be6c-eab60d7c916d was qcow2, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:44:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:26 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee Nov 01 09:44:26 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:28 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee" returned: 0 in 2.029s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_xuzbbnxpdevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:44:28 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Converted 112.00 MB image at 55.14 MB/s Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:28 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee 1G Nov 01 09:44:28 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:28 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee 1G" returned: 0 in 0.347s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Downloaded image c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 9646b5c1-2b0c-4675-afb4-e5fdd4da41ee successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d for user 188a12a18dea4cffa8c615bf95cb1cae is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Marking volume 9646b5c1-2b0c-4675-afb4-e5fdd4da41ee as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Copying metadata from image c507ec59-c87f-4d5c-be6c-eab60d7c916d to 9646b5c1-2b0c-4675-afb4-e5fdd4da41ee. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:44:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Creating volume glance metadata for volume 9646b5c1-2b0c-4675-afb4-e5fdd4da41ee backed by image c507ec59-c87f-4d5c-be6c-eab60d7c916d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:44:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6f01529-7773-46f5-874c-6c6c1fea96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04027f93-ed15-4786-8f9a-848bbf5ef8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:29 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Volume volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee (9646b5c1-2b0c-4675-afb4-e5fdd4da41ee): created successfully Nov 01 09:44:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04027f93-ed15-4786-8f9a-848bbf5ef8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Flow 'volume_create_manager' (7273b264-4427-4344-af10-ba36b150c268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-620dc19b-a669-4c7e-ae67-9253aa1b9959 tempest-VolumesExtendTest-687336619 None] Created volume successfully. Nov 01 09:44:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e3b715f-a99b-426e-8c18-d8a093e41037 tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e3b715f-a99b-426e-8c18-d8a093e41037 tempest-VolumesExtendTest-687336619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:30 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c2bde1-a3ac-4fe9-be72-5ed5f61c9286]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e3b715f-a99b-426e-8c18-d8a093e41037 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:30 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee Nov 01 09:44:30 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:30 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e3b715f-a99b-426e-8c18-d8a093e41037 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee" returned: 0 in 0.428s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e3b715f-a99b-426e-8c18-d8a093e41037 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee 2G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e3b715f-a99b-426e-8c18-d8a093e41037 tempest-VolumesExtendTest-687336619 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee 2G" returned: 0 in 0.118s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e3b715f-a99b-426e-8c18-d8a093e41037 tempest-VolumesExtendTest-687336619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.589s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5e3b715f-a99b-426e-8c18-d8a093e41037 tempest-VolumesExtendTest-687336619 None] Extend volume completed successfully. Nov 01 09:44:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Acquiring lock "cinder-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Lock "cinder-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Acquiring lock "cinder-quobyte-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Lock "cinder-quobyte-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee" acquired by "delete_volume" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:31 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36f50f5-b89a-4c99-82fb-acd549cfd209]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:31 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee Nov 01 09:44:31 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:32 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee" returned: 0 in 0.504s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:32 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee Nov 01 09:44:32 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:32 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee" returned: 0 in 0.426s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Lock "cinder-quobyte-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee" released by "delete_volume" :: held 0.988s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:32 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Created reservations ['05fc86df-bd44-4500-9d08-8af14514db10', '5e1af5d3-218f-4781-a774-66bd60a0de79', '00ea370a-e69e-4b9a-8959-330fb39f4bfc', '9e18b694-a2ba-43e2-9889-9a05b253ccf3'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:33 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:44:33 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:33 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.491s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:44:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Deleted volume successfully. Nov 01 09:44:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2951a71-3ff5-4a23-b12d-702351210f78 tempest-VolumesExtendTest-687336619 None] Lock "cinder-9646b5c1-2b0c-4675-afb4-e5fdd4da41ee-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Flow 'volume_create_manager' (69ccb226-306c-4322-8c17-39bde4d90888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b4b6e6-e10c-44d7-b482-b4b2f31ab7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b4b6e6-e10c-44d7-b482-b4b2f31ab7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-695962195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce18d081-2669-45f2-ae62-b468cca38731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54df663f69d44d1b250a1eecbec6532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:35Z,use_quota=True,user_id='188a12a18dea4cffa8c615bf95cb1cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb73e2d-534e-4a92-9f34-19f3f601ddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eb73e2d-534e-4a92-9f34-19f3f601ddb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f11e0fd-c3ed-4ca1-af93-6318f4bde396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f11e0fd-c3ed-4ca1-af93-6318f4bde396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce18d081-2669-45f2-ae62-b468cca38731', 'volume_name': 'volume-ce18d081-2669-45f2-ae62-b468cca38731', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabf06b4-d5b8-4c2e-8f6b-c5b0cc083981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabf06b4-d5b8-4c2e-8f6b-c5b0cc083981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc05487-2b44-473b-a73c-9eb03fb1da3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:34 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Volume ce18d081-2669-45f2-ae62-b468cca38731: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce18d081-2669-45f2-ae62-b468cca38731', 'volume_size': 1} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-695962195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce18d081-2669-45f2-ae62-b468cca38731,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f54df663f69d44d1b250a1eecbec6532',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:35Z,use_quota=True,user_id='188a12a18dea4cffa8c615bf95cb1cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Creating volume ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:44:34 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:44:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:34 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 1073741824 Nov 01 09:44:34 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:35 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 1073741824" returned: 0 in 0.499s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:35 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 Nov 01 09:44:35 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:35 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731" returned: 0 in 0.418s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bc05487-2b44-473b-a73c-9eb03fb1da3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce18d081-2669-45f2-ae62-b468cca38731', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc75ab02-c1f7-49d8-9862-f8df84416d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:35 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Volume volume-ce18d081-2669-45f2-ae62-b468cca38731 (ce18d081-2669-45f2-ae62-b468cca38731): created successfully Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc75ab02-c1f7-49d8-9862-f8df84416d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Flow 'volume_create_manager' (69ccb226-306c-4322-8c17-39bde4d90888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-88da5873-5a0f-41fb-bd16-ce35a9af1a73 tempest-VolumesExtendTest-687336619 None] Created volume successfully. Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Creating offline snapshot 692d0659-bb5b-4ab1-baeb-694c06b19961 of volume ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a714edc3-ddf6-4e10-bcae-cf1eb35254b3]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:37 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 Nov 01 09:44:37 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:37 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731" returned: 0 in 0.404s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:37 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 1G Nov 01 09:44:37 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:37 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 1G" returned: 0 in 0.435s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce18d081-2669-45f2-ae62-b468cca38731 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:37 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce18d081-2669-45f2-ae62-b468cca38731 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 Nov 01 09:44:37 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:38 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce18d081-2669-45f2-ae62-b468cca38731 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961" returned: 0 in 0.400s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:38 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 is being set with open permissions: ugo+rw Nov 01 09:44:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:38 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 Nov 01 09:44:38 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:38 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961" returned: 0 in 0.338s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:38 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.info Nov 01 09:44:38 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Flow 'volume_create_manager' (a9c4b284-0fdd-4f2c-861d-97db3bbb8e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f47be5d-fa78-455d-840b-a5fad53f9763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f47be5d-fa78-455d-840b-a5fad53f9763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-809042732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12b1f04-a3c9-4e39-ada2-3020b93b09b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1b7ea0948e4ceaba50ced97629cc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:39Z,use_quota=True,user_id='35b3e54df6114725861ef8af09c99184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f7d492-db9f-44bc-b45a-0aed8c3b2c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f7d492-db9f-44bc-b45a-0aed8c3b2c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed0c1a0-138c-4c2e-8d37-e3dab168e4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed0c1a0-138c-4c2e-8d37-e3dab168e4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12b1f04-a3c9-4e39-ada2-3020b93b09b0', 'volume_name': 'volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f2a74e-6237-4217-b107-d9e7298cbb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:39 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f2a74e-6237-4217-b107-d9e7298cbb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afd2fd8-96ea-40b4-ae20-6d4ee1a55bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:39 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Volume a12b1f04-a3c9-4e39-ada2-3020b93b09b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0', 'volume_size': 1} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.info" returned: 0 in 0.423s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:39 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.info is being set with open permissions: ugo+rw Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:39 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.info Nov 01 09:44:39 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:39 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.info" returned: 0 in 0.281s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-809042732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12b1f04-a3c9-4e39-ada2-3020b93b09b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b1b7ea0948e4ceaba50ced97629cc34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:39Z,use_quota=True,user_id='35b3e54df6114725861ef8af09c99184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Creating volume a12b1f04-a3c9-4e39-ada2-3020b93b09b0 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:44:39 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:39 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 1073741824 Nov 01 09:44:39 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-74332651-dade-470e-9d2b-8d1a729d3a9d tempest-VolumesExtendTest-687336619 None] Create snapshot completed successfully Nov 01 09:44:39 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 1073741824" returned: 0 in 0.450s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:40 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 Nov 01 09:44:40 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:40 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0" returned: 0 in 0.265s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afd2fd8-96ea-40b4-ae20-6d4ee1a55bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a644d0a-8ec1-4ee3-a72b-791c3ed49067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:40 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Volume volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 (a12b1f04-a3c9-4e39-ada2-3020b93b09b0): created successfully Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a644d0a-8ec1-4ee3-a72b-791c3ed49067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Flow 'volume_create_manager' (a9c4b284-0fdd-4f2c-861d-97db3bbb8e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:40 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-202ab37a-d2d5-45d1-88bd-5ccb318fcd9d tempest-TestMinimumBasicScenario-1646824304 None] Created volume successfully. Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff53e73d-46b6-4c0f-8b80-8046b8637cb6 tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff53e73d-46b6-4c0f-8b80-8046b8637cb6 tempest-VolumesExtendTest-687336619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[58324547-67f0-4db4-bdfa-14f3959eea45]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ff53e73d-46b6-4c0f-8b80-8046b8637cb6 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:40 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 Nov 01 09:44:40 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:40 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ff53e73d-46b6-4c0f-8b80-8046b8637cb6 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731" returned: 0 in 0.367s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ff53e73d-46b6-4c0f-8b80-8046b8637cb6 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 2G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ff53e73d-46b6-4c0f-8b80-8046b8637cb6 tempest-VolumesExtendTest-687336619 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 2G" returned: 0 in 0.137s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ff53e73d-46b6-4c0f-8b80-8046b8637cb6 tempest-VolumesExtendTest-687336619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.543s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:40 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ff53e73d-46b6-4c0f-8b80-8046b8637cb6 tempest-VolumesExtendTest-687336619 None] Extend volume completed successfully. Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Acquiring lock "cinder-692d0659-bb5b-4ab1-baeb-694c06b19961-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Lock "cinder-692d0659-bb5b-4ab1-baeb-694c06b19961-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Acquiring lock "cinder-quobyte-ce18d081-2669-45f2-ae62-b468cca38731" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Lock "cinder-quobyte-ce18d081-2669-45f2-ae62-b468cca38731" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Acquiring lock "cinder-quobyte-692d0659-bb5b-4ab1-baeb-694c06b19961" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Lock "cinder-quobyte-692d0659-bb5b-4ab1-baeb-694c06b19961" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Deleting offline snapshot 692d0659-bb5b-4ab1-baeb-694c06b19961 of volume ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] snapshot_file for this snap is: volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[901a6130-3c31-4558-88d3-2f2905d393ba]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:42 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 Nov 01 09:44:42 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6bc82945-ec36-4b07-845d-4123425066fe req-a9c2c50c-db86-465a-a563-e4182e01e411 tempest-TestMinimumBasicScenario-1646824304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6bc82945-ec36-4b07-845d-4123425066fe req-a9c2c50c-db86-465a-a563-e4182e01e411 tempest-TestMinimumBasicScenario-1646824304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-6bc82945-ec36-4b07-845d-4123425066fe req-a9c2c50c-db86-465a-a563-e4182e01e411 tempest-TestMinimumBasicScenario-1646824304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-6bc82945-ec36-4b07-845d-4123425066fe req-a9c2c50c-db86-465a-a563-e4182e01e411 tempest-TestMinimumBasicScenario-1646824304 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0942482c-2989-4232-ba3b-c4e0ede0bb5e', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:44:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-6bc82945-ec36-4b07-845d-4123425066fe req-a9c2c50c-db86-465a-a563-e4182e01e411 tempest-TestMinimumBasicScenario-1646824304 None] attachment_update completed successfully. Nov 01 09:44:42 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961" returned: 0 in 0.486s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce18d081-2669-45f2-ae62-b468cca38731(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1045b026-721f-49fd-9592-242aac439bd4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:42 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 Nov 01 09:44:42 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:42 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731" returned: 0 in 0.493s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:42 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 Nov 01 09:44:42 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:43 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961" returned: 0 in 0.436s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:43 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961 Nov 01 09:44:43 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:43 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731.692d0659-bb5b-4ab1-baeb-694c06b19961" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Lock "cinder-quobyte-692d0659-bb5b-4ab1-baeb-694c06b19961" released by "_delete_snapshot" :: held 1.861s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Lock "cinder-quobyte-ce18d081-2669-45f2-ae62-b468cca38731" released by "delete_snapshot" :: held 1.911s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:43 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Created reservations ['3c14a051-8af4-4338-a729-5dea7936c7fa', 'afb43c1c-5d02-4d40-8cc4-089bdcf670a8', '45240ca7-66b4-439a-9a10-675c8c094798', 'd9dc04e1-a314-4aaf-b6ea-947bbf4d11c7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:44:43 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Delete snapshot completed successfully. Nov 01 09:44:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-00c487c0-9ed9-49e6-b173-b70f4d7d8422 tempest-VolumesExtendTest-687336619 None] Lock "cinder-692d0659-bb5b-4ab1-baeb-694c06b19961-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Acquiring lock "cinder-ce18d081-2669-45f2-ae62-b468cca38731-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Lock "cinder-ce18d081-2669-45f2-ae62-b468cca38731-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Acquiring lock "cinder-quobyte-ce18d081-2669-45f2-ae62-b468cca38731" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Lock "cinder-quobyte-ce18d081-2669-45f2-ae62-b468cca38731" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[003b102c-b78b-4a91-b1ab-5ed74aafa9b0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:44 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 Nov 01 09:44:44 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:44 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731" returned: 0 in 0.403s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:44 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731 Nov 01 09:44:44 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:44 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ce18d081-2669-45f2-ae62-b468cca38731" returned: 0 in 0.276s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Lock "cinder-quobyte-ce18d081-2669-45f2-ae62-b468cca38731" released by "delete_volume" :: held 0.757s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:44 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Created reservations ['02cecc99-912d-4794-8dd3-d3eda6ea1ee1', 'ea72f789-e0ff-45ba-a12d-a73bdbaa80c8', 'e376a912-4b41-4531-a0b0-f857a09eef0e', '904ed59e-4d0b-4aa5-a3b3-2a7b38747f27'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:45 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:44:45 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:45 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.430s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:44:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Deleted volume successfully. Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Flow 'volume_create_manager' (cce8d190-3dff-405a-8fea-1dfd4cdc5c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a471df-acf0-4a82-96d4-664a17d79405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-02e00d7a-0e39-4afa-995e-7156a9a1c351 tempest-VolumesExtendTest-687336619 None] Lock "cinder-ce18d081-2669-45f2-ae62-b468cca38731-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a471df-acf0-4a82-96d4-664a17d79405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-10491455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf08704-76e2-4a14-b303-ede78436567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b10a866ca74796b00731bbdb648f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:45Z,use_quota=True,user_id='de97136f5d304a968e5883bbd023c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f85fb08-7ee2-41e8-bf81-2be269d66088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f85fb08-7ee2-41e8-bf81-2be269d66088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586bce37-237d-432a-abf4-185266373971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586bce37-237d-432a-abf4-185266373971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf08704-76e2-4a14-b303-ede78436567a', 'volume_name': 'volume-ccf08704-76e2-4a14-b303-ede78436567a', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337ac982-fe03-45ce-bed9-135e3f8bd1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337ac982-fe03-45ce-bed9-135e3f8bd1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a63e698-4a68-480f-930b-76e74ff59a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:45 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Volume ccf08704-76e2-4a14-b303-ede78436567a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf08704-76e2-4a14-b303-ede78436567a', 'volume_size': 1} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-10491455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf08704-76e2-4a14-b303-ede78436567a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40b10a866ca74796b00731bbdb648f68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:45Z,use_quota=True,user_id='de97136f5d304a968e5883bbd023c2fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Creating volume ccf08704-76e2-4a14-b303-ede78436567a {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:44:45 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:44:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:45 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a 1073741824 Nov 01 09:44:45 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:46 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a 1073741824" returned: 0 in 0.561s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:46 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a Nov 01 09:44:46 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:46 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a" returned: 0 in 0.403s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a63e698-4a68-480f-930b-76e74ff59a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf08704-76e2-4a14-b303-ede78436567a', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b78de0-6295-47ea-8d3f-fa945697f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:46 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Volume volume-ccf08704-76e2-4a14-b303-ede78436567a (ccf08704-76e2-4a14-b303-ede78436567a): created successfully Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b78de0-6295-47ea-8d3f-fa945697f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Flow 'volume_create_manager' (cce8d190-3dff-405a-8fea-1dfd4cdc5c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-67922cad-3bf8-4e2b-8b0a-0e013ac41ecc tempest-AttachVolumeNegativeTest-1317075963 None] Created volume successfully. Nov 01 09:44:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-27b1a324-ab83-40fa-8c0e-d031d4b8111d req-1e1a7ce3-c16f-45a1-a1ae-9430839c9a65 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-27b1a324-ab83-40fa-8c0e-d031d4b8111d req-1e1a7ce3-c16f-45a1-a1ae-9430839c9a65 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-27b1a324-ab83-40fa-8c0e-d031d4b8111d req-1e1a7ce3-c16f-45a1-a1ae-9430839c9a65 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:49 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-27b1a324-ab83-40fa-8c0e-d031d4b8111d req-1e1a7ce3-c16f-45a1-a1ae-9430839c9a65 tempest-AttachVolumeNegativeTest-1317075963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-ccf08704-76e2-4a14-b303-ede78436567a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6df09f89-9353-4744-b1ac-cf1282e4163b', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:44:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-27b1a324-ab83-40fa-8c0e-d031d4b8111d req-1e1a7ce3-c16f-45a1-a1ae-9430839c9a65 tempest-AttachVolumeNegativeTest-1317075963 None] attachment_update completed successfully. Nov 01 09:44:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-d7117b24-c7ff-4c44-a174-5eadd54c9b36 req-29493ad0-72e9-4013-b980-a69c7513c083 tempest-AttachVolumeNegativeTest-1317075963 None] Terminate volume connection completed successfully. Nov 01 09:44:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-d7117b24-c7ff-4c44-a174-5eadd54c9b36 req-29493ad0-72e9-4013-b980-a69c7513c083 tempest-AttachVolumeNegativeTest-1317075963 None] Deleting attachment 6df09f89-9353-4744-b1ac-cf1282e4163b. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:53 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:44:53 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:53 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.311s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:44:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:44:54 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:44:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Flow 'volume_create_manager' (e264528d-343d-450c-972a-a383ba495172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bdff05-8e29-40cd-89e4-c0edd05aae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bdff05-8e29-40cd-89e4-c0edd05aae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696819362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f458a39-731b-4e48-bddc-b59fd5380469,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a143d9f866d74233aeca7e82197a3abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:55Z,use_quota=True,user_id='321b8a4586c54f43a45c26399cb13f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2617548-f641-4382-8565-a0a5149552f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2617548-f641-4382-8565-a0a5149552f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02275d71-63b1-4d7e-800e-7d4c1716695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02275d71-63b1-4d7e-800e-7d4c1716695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f458a39-731b-4e48-bddc-b59fd5380469', 'volume_name': 'volume-6f458a39-731b-4e48-bddc-b59fd5380469', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9656362c-2842-401e-a187-d0a745698154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9656362c-2842-401e-a187-d0a745698154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f35d62-da99-475c-af9e-c708a570a449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:55 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Volume 6f458a39-731b-4e48-bddc-b59fd5380469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f458a39-731b-4e48-bddc-b59fd5380469', 'volume_size': 1} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-696819362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f458a39-731b-4e48-bddc-b59fd5380469,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a143d9f866d74233aeca7e82197a3abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:55Z,use_quota=True,user_id='321b8a4586c54f43a45c26399cb13f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Creating volume 6f458a39-731b-4e48-bddc-b59fd5380469 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:44:55 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:55 devstack sudo[100248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 1073741824 Nov 01 09:44:55 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:55 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 1073741824" returned: 0 in 0.470s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:55 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 Nov 01 09:44:55 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:55 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469" returned: 0 in 0.284s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f35d62-da99-475c-af9e-c708a570a449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f458a39-731b-4e48-bddc-b59fd5380469', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9b301e-ad78-4fec-9e1a-ed30329d5990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:55 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Volume volume-6f458a39-731b-4e48-bddc-b59fd5380469 (6f458a39-731b-4e48-bddc-b59fd5380469): created successfully Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9b301e-ad78-4fec-9e1a-ed30329d5990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:55 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Flow 'volume_create_manager' (e264528d-343d-450c-972a-a383ba495172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1059481d-75bc-4829-8439-de5df9bf31b4 tempest-VolumesListTestJSON-203919885 None] Created volume successfully. Nov 01 09:44:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "cinder-ccf08704-76e2-4a14-b303-ede78436567a-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-ccf08704-76e2-4a14-b303-ede78436567a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "cinder-quobyte-ccf08704-76e2-4a14-b303-ede78436567a" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-quobyte-ccf08704-76e2-4a14-b303-ede78436567a" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a018be-de61-4948-a199-330e3c1a3bb8]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:56 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a Nov 01 09:44:56 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:56 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a" returned: 0 in 0.370s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:56 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a Nov 01 09:44:56 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:57 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ccf08704-76e2-4a14-b303-ede78436567a" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-quobyte-ccf08704-76e2-4a14-b303-ede78436567a" released by "delete_volume" :: held 0.686s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Created reservations ['e4af863a-94ad-4fe5-94ab-6e9efa2820e6', '08b582a0-fea3-4357-b25d-82c40033d9bd', '3551e35d-0f24-4f38-b2d6-5efffcc02e48', '6f8ec5cc-093b-46b8-b21c-13e444a6b70e'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:57 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:44:57 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:57 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.272s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:44:57 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Deleted volume successfully. Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Flow 'volume_create_manager' (683f039d-92cc-4f68-a101-7600134e0f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2432f11c-de0d-4a7a-8264-3e5b4c8d392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b188996-f39b-4ac3-9869-7fb2aebcf057 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-ccf08704-76e2-4a14-b303-ede78436567a-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2432f11c-de0d-4a7a-8264-3e5b4c8d392b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2025696336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baae11e0-2fec-48f2-aabd-edf89b7b3248,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a143d9f866d74233aeca7e82197a3abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:58Z,use_quota=True,user_id='321b8a4586c54f43a45c26399cb13f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5c73fd-6b0a-4451-bf43-b07b4e159ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5c73fd-6b0a-4451-bf43-b07b4e159ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b64b58-f5a1-47bb-8786-955787c7b681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09b64b58-f5a1-47bb-8786-955787c7b681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baae11e0-2fec-48f2-aabd-edf89b7b3248', 'volume_name': 'volume-baae11e0-2fec-48f2-aabd-edf89b7b3248', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0132ce57-a773-4afa-a7b1-430181709a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0132ce57-a773-4afa-a7b1-430181709a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a86d29-b3f7-4464-a6c3-94d7b9959062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:57 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Volume baae11e0-2fec-48f2-aabd-edf89b7b3248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baae11e0-2fec-48f2-aabd-edf89b7b3248', 'volume_size': 1} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2025696336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baae11e0-2fec-48f2-aabd-edf89b7b3248,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a143d9f866d74233aeca7e82197a3abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:44:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:44:58Z,use_quota=True,user_id='321b8a4586c54f43a45c26399cb13f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Creating volume baae11e0-2fec-48f2-aabd-edf89b7b3248 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:44:57 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "cinder-a6d76696-af65-4b51-bae1-2723d1c7c77b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:57 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 1073741824 Nov 01 09:44:57 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-a6d76696-af65-4b51-bae1-2723d1c7c77b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "cinder-quobyte-a6d76696-af65-4b51-bae1-2723d1c7c77b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-quobyte-a6d76696-af65-4b51-bae1-2723d1c7c77b" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[255260a8-5533-4d70-ad93-e09379f91aef]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:57 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b Nov 01 09:44:57 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:58 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 1073741824" returned: 0 in 0.561s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:58 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b" returned: 0 in 0.432s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:58 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b Nov 01 09:44:58 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:58 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 Nov 01 09:44:58 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:58 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a6d76696-af65-4b51-bae1-2723d1c7c77b" returned: 0 in 0.297s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-quobyte-a6d76696-af65-4b51-bae1-2723d1c7c77b" released by "delete_volume" :: held 0.788s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:58 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248" returned: 0 in 0.293s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a86d29-b3f7-4464-a6c3-94d7b9959062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baae11e0-2fec-48f2-aabd-edf89b7b3248', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0481d60c-3af4-40cd-aea5-736f93961fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:44:58 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Volume volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 (baae11e0-2fec-48f2-aabd-edf89b7b3248): created successfully Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0481d60c-3af4-40cd-aea5-736f93961fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Flow 'volume_create_manager' (683f039d-92cc-4f68-a101-7600134e0f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Created reservations ['f5ee892e-e954-4ad1-bbe5-0cab47d3feb0', 'be3a844a-aaf2-45c2-9ad5-c15ade7025f6', '5edcd969-bc66-43e8-be16-3a832fc198cf', '67bc816f-86ed-4e03-8fdb-aea0ed59d503'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:44:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bb09af00-6afb-4f73-a2ef-1a3b1a0575fd tempest-VolumesListTestJSON-203919885 None] Created volume successfully. Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:44:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:58 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:44:58 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "cinder-372a858a-e5f8-4e5d-b567-dab7cf04b83b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:59 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.304s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:44:59 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Deleted volume successfully. Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-372a858a-e5f8-4e5d-b567-dab7cf04b83b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0c77c0f7-7bbb-48f6-83f8-d2002303166a tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-a6d76696-af65-4b51-bae1-2723d1c7c77b-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "cinder-quobyte-372a858a-e5f8-4e5d-b567-dab7cf04b83b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-quobyte-372a858a-e5f8-4e5d-b567-dab7cf04b83b" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b160f777-2c21-4431-9042-850c4b6fcdb5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:59 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b Nov 01 09:44:59 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:59 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b" returned: 0 in 0.389s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:44:59 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b Nov 01 09:44:59 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:44:59 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-372a858a-e5f8-4e5d-b567-dab7cf04b83b" returned: 0 in 0.309s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:44:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-quobyte-372a858a-e5f8-4e5d-b567-dab7cf04b83b" released by "delete_volume" :: held 0.784s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Created reservations ['97288632-6c9f-45bf-bdf3-8276b45cbb82', '875cf0bf-7309-499e-a5d3-ed66fe6cbbc2', '6ced5f5d-bd62-44b9-af17-fa881f4ba434', 'e966aa97-c3fe-4d01-adf9-6104e0538919'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:00 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:00 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Flow 'volume_create_manager' (9205fa65-d916-4064-89ad-3ac4e6bc9b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4b984c-e300-40f5-93cb-5232c810ae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4b984c-e300-40f5-93cb-5232c810ae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1843209054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3353c194-e3c9-408d-bb12-8917e34834aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a143d9f866d74233aeca7e82197a3abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:00Z,use_quota=True,user_id='321b8a4586c54f43a45c26399cb13f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb69e9b-3959-41f1-b7ad-95058721088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbb69e9b-3959-41f1-b7ad-95058721088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cd6c7e-26b5-4d8c-8f59-bc31bc57abd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0cd6c7e-26b5-4d8c-8f59-bc31bc57abd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3353c194-e3c9-408d-bb12-8917e34834aa', 'volume_name': 'volume-3353c194-e3c9-408d-bb12-8917e34834aa', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15174547-43dd-431d-9cc4-1c665d4c552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15174547-43dd-431d-9cc4-1c665d4c552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d55ac3-6300-486c-bb98-39e277083b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:00 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Volume 3353c194-e3c9-408d-bb12-8917e34834aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3353c194-e3c9-408d-bb12-8917e34834aa', 'volume_size': 1} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1843209054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3353c194-e3c9-408d-bb12-8917e34834aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a143d9f866d74233aeca7e82197a3abc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:00Z,use_quota=True,user_id='321b8a4586c54f43a45c26399cb13f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Creating volume 3353c194-e3c9-408d-bb12-8917e34834aa {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:00 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:45:00 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.366s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:00 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Deleted volume successfully. Nov 01 09:45:00 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa 1073741824 Nov 01 09:45:00 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9384d4c-46bf-49c6-a494-490a2f4b8742 tempest-AttachVolumeNegativeTest-1317075963 None] Lock "cinder-372a858a-e5f8-4e5d-b567-dab7cf04b83b-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:01 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa 1073741824" returned: 0 in 0.576s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:01 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa Nov 01 09:45:01 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:01 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa" returned: 0 in 0.270s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9d55ac3-6300-486c-bb98-39e277083b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3353c194-e3c9-408d-bb12-8917e34834aa', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbca136-01c3-4b32-9ef8-bd5fe19ae7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:01 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Volume volume-3353c194-e3c9-408d-bb12-8917e34834aa (3353c194-e3c9-408d-bb12-8917e34834aa): created successfully Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbbca136-01c3-4b32-9ef8-bd5fe19ae7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Flow 'volume_create_manager' (9205fa65-d916-4064-89ad-3ac4e6bc9b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:01 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-623f2ed2-c80a-49d7-a299-84cda28d7f02 tempest-VolumesListTestJSON-203919885 None] Created volume successfully. Nov 01 09:45:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "cinder-3353c194-e3c9-408d-bb12-8917e34834aa-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-3353c194-e3c9-408d-bb12-8917e34834aa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:05 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=96,cinder:SELECT=81,cinder:DELETE=7,cinder:INSERT=27 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:45:05 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=100,cinder:SELECT=88,cinder:INSERT=27,cinder:DELETE=9 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:45:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "cinder-quobyte-3353c194-e3c9-408d-bb12-8917e34834aa" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-quobyte-3353c194-e3c9-408d-bb12-8917e34834aa" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:05 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a323b04-e404-4659-9217-697547cef359]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:05 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa Nov 01 09:45:05 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:05 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa" returned: 0 in 0.500s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:06 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa Nov 01 09:45:06 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:06 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3353c194-e3c9-408d-bb12-8917e34834aa" returned: 0 in 0.311s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-quobyte-3353c194-e3c9-408d-bb12-8917e34834aa" released by "delete_volume" :: held 0.899s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Created reservations ['90d8c06b-1acc-465b-9b60-124a725c84ea', 'ff6f26ac-1b7e-4b45-a22a-aa7f303a93b4', '2d83e19d-06de-49bc-bd17-02ef5e596be0', 'efb039da-ef5e-4f33-b636-0c80c608adb2'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:06 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:06 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:06 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.384s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Deleted volume successfully. Nov 01 09:45:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-289b2731-e864-4e82-858f-8f3b7100d4c1 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-3353c194-e3c9-408d-bb12-8917e34834aa-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "cinder-baae11e0-2fec-48f2-aabd-edf89b7b3248-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-baae11e0-2fec-48f2-aabd-edf89b7b3248-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "cinder-quobyte-baae11e0-2fec-48f2-aabd-edf89b7b3248" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-quobyte-baae11e0-2fec-48f2-aabd-edf89b7b3248" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:07 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ecb714-edb0-45b1-a110-776ad5ff6fc6]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:07 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 Nov 01 09:45:07 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:08 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248" returned: 0 in 0.422s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:08 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248 Nov 01 09:45:08 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:08 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-baae11e0-2fec-48f2-aabd-edf89b7b3248" returned: 0 in 0.261s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-quobyte-baae11e0-2fec-48f2-aabd-edf89b7b3248" released by "delete_volume" :: held 0.744s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Created reservations ['686838f9-a1e0-462a-9fe4-e515c715efa6', 'cc19c40d-0eb3-465d-9b53-c7b21cdf96b6', '46f30625-30aa-4a95-bc19-162b765eb515', '8033c09d-74b0-4dd7-9b84-c14db4a572f7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:08 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:08 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "cinder-6f458a39-731b-4e48-bddc-b59fd5380469-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-6f458a39-731b-4e48-bddc-b59fd5380469-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "cinder-quobyte-6f458a39-731b-4e48-bddc-b59fd5380469" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-quobyte-6f458a39-731b-4e48-bddc-b59fd5380469" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:09 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Deleted volume successfully. Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afe33f6-c52c-4c27-b809-6afd40fb5525]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5ee1b852-99d3-4fc9-8b2d-266bb098d017 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-baae11e0-2fec-48f2-aabd-edf89b7b3248-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:09 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 Nov 01 09:45:09 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:09 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469" returned: 0 in 0.392s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:09 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469 Nov 01 09:45:09 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:09 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6f458a39-731b-4e48-bddc-b59fd5380469" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-quobyte-6f458a39-731b-4e48-bddc-b59fd5380469" released by "delete_volume" :: held 0.741s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Created reservations ['594fffa5-284c-46a7-a0c8-2ce42db53c19', '6f457cb7-ff28-4eba-b483-1737687532e3', '9d7311cb-c40f-453e-9d2b-c75e2064b0b2', '30db8d14-ce70-4757-95ce-e454246d7d24'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:09 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:09 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:10 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.323s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:10 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Deleted volume successfully. Nov 01 09:45:10 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b939ce1-7c08-4ecd-9c53-193a82a71313 tempest-VolumesListTestJSON-203919885 None] Lock "cinder-6f458a39-731b-4e48-bddc-b59fd5380469-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Flow 'volume_create_manager' (a94644bb-7419-4c1e-8ee0-e9a8cf69b8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfe286a-d7eb-4a30-be25-5dd529115558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bfe286a-d7eb-4a30-be25-5dd529115558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1797607518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf823bb-3598-47fc-bad8-283d42c60826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2c627a912d471db948fdec04cde2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:14Z,use_quota=True,user_id='c502cb03d4f8497199795bfe6d62a890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47876983-3424-40d5-8235-001bf2b9d7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47876983-3424-40d5-8235-001bf2b9d7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b73270-34cc-47c1-953f-28518930a1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b73270-34cc-47c1-953f-28518930a1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf823bb-3598-47fc-bad8-283d42c60826', 'volume_name': 'volume-fbf823bb-3598-47fc-bad8-283d42c60826', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fc9fd9-d3c3-4b12-8d6e-286639b1f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66fc9fd9-d3c3-4b12-8d6e-286639b1f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e87c8a6-0671-426f-ab8b-048309d5bb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:14 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Volume fbf823bb-3598-47fc-bad8-283d42c60826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf823bb-3598-47fc-bad8-283d42c60826', 'volume_size': 1} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1797607518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf823bb-3598-47fc-bad8-283d42c60826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2c627a912d471db948fdec04cde2a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:14Z,use_quota=True,user_id='c502cb03d4f8497199795bfe6d62a890',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Creating volume fbf823bb-3598-47fc-bad8-283d42c60826 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:45:14 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:14 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 1073741824 Nov 01 09:45:14 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:14 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 1073741824" returned: 0 in 0.496s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:14 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 Nov 01 09:45:14 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:15 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826" returned: 0 in 0.303s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:45:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e87c8a6-0671-426f-ab8b-048309d5bb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf823bb-3598-47fc-bad8-283d42c60826', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6288e0e8-efdc-4b79-86ec-66c723af3b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:15 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Volume volume-fbf823bb-3598-47fc-bad8-283d42c60826 (fbf823bb-3598-47fc-bad8-283d42c60826): created successfully Nov 01 09:45:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6288e0e8-efdc-4b79-86ec-66c723af3b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Flow 'volume_create_manager' (a94644bb-7419-4c1e-8ee0-e9a8cf69b8c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a549a4cf-774a-4cfa-aa9c-e028d56711a7 tempest-VolumesNegativeTest-1316424674 None] Created volume successfully. Nov 01 09:45:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1dcf673b-4f53-4da7-a359-362d386e69c6 tempest-GroupsTest-124524329 None] Group tempest-Group1-535729462: creating Nov 01 09:45:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1dcf673b-4f53-4da7-a359-362d386e69c6 tempest-GroupsTest-124524329 None] Group tempest-Group1-535729462: created successfully Nov 01 09:45:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1dcf673b-4f53-4da7-a359-362d386e69c6 tempest-GroupsTest-124524329 None] Create group completed successfully. Nov 01 09:45:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-13b35c90-592d-485f-b83d-832b537130e8 tempest-GroupsTest-124524329 None] Group tempest-Group2-685977858: creating Nov 01 09:45:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-13b35c90-592d-485f-b83d-832b537130e8 tempest-GroupsTest-124524329 None] Group tempest-Group2-685977858: created successfully Nov 01 09:45:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-13b35c90-592d-485f-b83d-832b537130e8 tempest-GroupsTest-124524329 None] Create group completed successfully. Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Flow 'volume_create_manager' (da18fc92-379c-4810-bdb8-26107e770f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42098ac-5ff0-4abe-b52f-c93be64ad031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e42098ac-5ff0-4abe-b52f-c93be64ad031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117711508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef2f2efe-5585-4377-ab6b-1073c0850c26,host='devstack@QuobyteHD#QuobyteHD',id=6df9db5c-ae78-4157-87ad-a74fbc455456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59a6d58c7f84f33bffe795686d039b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:24Z,use_quota=True,user_id='9346c1d812c04eb3b85e6cb0f4620cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cb85b-f025-4ee5-b601-58f34c93187b),volume_type_id=5f5cb85b-f025-4ee5-b601-58f34c93187b)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a177e68c-d905-4aef-b3e4-0d71e65fd14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a177e68c-d905-4aef-b3e4-0d71e65fd14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f38dee-3a8e-4547-be5c-83ac09c60e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f38dee-3a8e-4547-be5c-83ac09c60e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df9db5c-ae78-4157-87ad-a74fbc455456', 'volume_name': 'volume-6df9db5c-ae78-4157-87ad-a74fbc455456', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b729b2-c4ee-48c6-ad33-572348f23f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b729b2-c4ee-48c6-ad33-572348f23f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe8f70d-27af-4451-bab0-052aece5286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Volume 6df9db5c-ae78-4157-87ad-a74fbc455456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df9db5c-ae78-4157-87ad-a74fbc455456', 'volume_size': 1} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef2f2efe-5585-4377-ab6b-1073c0850c26,created_at=2026-11-01T08:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117711508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef2f2efe-5585-4377-ab6b-1073c0850c26,host='devstack@QuobyteHD#QuobyteHD',id=6df9db5c-ae78-4157-87ad-a74fbc455456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59a6d58c7f84f33bffe795686d039b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:24Z,use_quota=True,user_id='9346c1d812c04eb3b85e6cb0f4620cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f5cb85b-f025-4ee5-b601-58f34c93187b),volume_type_id=5f5cb85b-f025-4ee5-b601-58f34c93187b)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Creating volume 6df9db5c-ae78-4157-87ad-a74fbc455456 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:45:23 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:45:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:23 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 1073741824 Nov 01 09:45:23 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:24 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 1073741824" returned: 0 in 0.455s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:24 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 Nov 01 09:45:24 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:24 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456" returned: 0 in 0.261s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe8f70d-27af-4451-bab0-052aece5286b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df9db5c-ae78-4157-87ad-a74fbc455456', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9948ef0f-5ddf-4495-9fc3-219525288329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:24 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Volume volume-6df9db5c-ae78-4157-87ad-a74fbc455456 (6df9db5c-ae78-4157-87ad-a74fbc455456): created successfully Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9948ef0f-5ddf-4495-9fc3-219525288329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Flow 'volume_create_manager' (da18fc92-379c-4810-bdb8-26107e770f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:24 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bbec155b-82b5-4c44-8a89-85e974458d2b tempest-GroupsTest-124524329 None] Created volume successfully. Nov 01 09:45:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Acquiring lock "cinder-quobyte-6df9db5c-ae78-4157-87ad-a74fbc455456" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Lock "cinder-quobyte-6df9db5c-ae78-4157-87ad-a74fbc455456" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:26 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[62861232-f67c-44ea-932c-c49300307448]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:26 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 Nov 01 09:45:26 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:26 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456" returned: 0 in 0.593s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:26 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456 Nov 01 09:45:26 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:27 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6df9db5c-ae78-4157-87ad-a74fbc455456" returned: 0 in 0.385s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Lock "cinder-quobyte-6df9db5c-ae78-4157-87ad-a74fbc455456" released by "delete_volume" :: held 1.066s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Created reservations ['01651d96-0bf7-4d14-bbbb-d6f5e0b23949'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:27 devstack cinder-volume[86594]: WARNING cinder.quota [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-864188169 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-864188169, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:45:27 devstack cinder-volume[86594]: WARNING cinder.quota [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-864188169 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-864188169, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Created reservations ['dfea4fa8-d3b7-4d40-b0c5-43b958db7105', '46641e8a-93f3-473c-82e6-cfc0dc114b90', '251c9064-77b4-4c56-8bb0-1bdc2e84c161', '2603707a-95d7-428a-b406-7156acaef961'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:27 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:27 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Created reservations ['e7936a4a-cae6-4fd3-bbb6-3c104a76d4e4'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:27 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:27 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:27 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.323s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:27 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d8ccae96-14c5-4610-81d4-77602534cb19 tempest-GroupsTest-124524329 None] Delete group completed successfully. Nov 01 09:45:28 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:28 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ee612324-b3dc-4f01-bde3-42fb00c1dc55 tempest-GroupsTest-124524329 None] Delete group completed successfully. Nov 01 09:45:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6872f12a-9746-463e-bd4c-05231a1124fe tempest-GroupsTest-124524329 None] Group tempest-GroupsTest-Group-258530441: creating Nov 01 09:45:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6872f12a-9746-463e-bd4c-05231a1124fe tempest-GroupsTest-124524329 None] Group tempest-GroupsTest-Group-258530441: created successfully Nov 01 09:45:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6872f12a-9746-463e-bd4c-05231a1124fe tempest-GroupsTest-124524329 None] Create group completed successfully. Nov 01 09:45:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-7a82697e-d9e5-4fe8-bdfc-c1ccc3e808f7 req-8d12d259-3254-420e-9999-a43448c34e39 tempest-TestMinimumBasicScenario-1646824304 None] Terminate volume connection completed successfully. Nov 01 09:45:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-7a82697e-d9e5-4fe8-bdfc-c1ccc3e808f7 req-8d12d259-3254-420e-9999-a43448c34e39 tempest-TestMinimumBasicScenario-1646824304 None] Deleting attachment 0942482c-2989-4232-ba3b-c4e0ede0bb5e. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:45:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Acquiring lock "cinder-a12b1f04-a3c9-4e39-ada2-3020b93b09b0-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Lock "cinder-a12b1f04-a3c9-4e39-ada2-3020b93b09b0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Acquiring lock "cinder-quobyte-a12b1f04-a3c9-4e39-ada2-3020b93b09b0" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Lock "cinder-quobyte-a12b1f04-a3c9-4e39-ada2-3020b93b09b0" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb81936-2fb3-497d-a8e6-652eeb352b78]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:31 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 Nov 01 09:45:31 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Flow 'volume_create_manager' (8fe44c43-41ef-4943-94a6-cd9a3ee27592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8f602d-0982-4b3d-a0ed-6057819e96ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8f602d-0982-4b3d-a0ed-6057819e96ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1883631655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0cf9c7b-8e71-4e29-8997-d1b7508b1dd9,host='devstack@QuobyteHD#QuobyteHD',id=cfb39b92-715b-4827-8f7d-402f53cf22de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59a6d58c7f84f33bffe795686d039b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:31Z,use_quota=True,user_id='9346c1d812c04eb3b85e6cb0f4620cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd2ae92d-6600-46e5-916c-8aee01180d0a),volume_type_id=dd2ae92d-6600-46e5-916c-8aee01180d0a)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a65b68-fe87-4856-84f0-8faeace776a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a65b68-fe87-4856-84f0-8faeace776a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888e5f58-e6fe-41f7-ba51-f058f2cc7a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888e5f58-e6fe-41f7-ba51-f058f2cc7a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb39b92-715b-4827-8f7d-402f53cf22de', 'volume_name': 'volume-cfb39b92-715b-4827-8f7d-402f53cf22de', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3806656-e614-472f-954e-fb230b740222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3806656-e614-472f-954e-fb230b740222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a79a17-a184-40e0-ac20-fb230878768d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:31 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Volume cfb39b92-715b-4827-8f7d-402f53cf22de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb39b92-715b-4827-8f7d-402f53cf22de', 'volume_size': 1} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0cf9c7b-8e71-4e29-8997-d1b7508b1dd9,created_at=2026-11-01T08:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1883631655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0cf9c7b-8e71-4e29-8997-d1b7508b1dd9,host='devstack@QuobyteHD#QuobyteHD',id=cfb39b92-715b-4827-8f7d-402f53cf22de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59a6d58c7f84f33bffe795686d039b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:31Z,use_quota=True,user_id='9346c1d812c04eb3b85e6cb0f4620cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd2ae92d-6600-46e5-916c-8aee01180d0a),volume_type_id=dd2ae92d-6600-46e5-916c-8aee01180d0a)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Creating volume cfb39b92-715b-4827-8f7d-402f53cf22de {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:45:31 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:31 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0" returned: 0 in 0.520s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:31 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de 1073741824 Nov 01 09:45:31 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:31 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0 Nov 01 09:45:31 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:31 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a12b1f04-a3c9-4e39-ada2-3020b93b09b0" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Lock "cinder-quobyte-a12b1f04-a3c9-4e39-ada2-3020b93b09b0" released by "delete_volume" :: held 0.865s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:31 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Created reservations ['f737cd58-b7ad-4350-9a41-65a750eeec50', '48b9ffd8-7631-4484-8db5-2c20be93e537', '0985a2fc-ff0e-489f-b316-ca2c40149e45', 'e57ed9bd-235e-44e6-90fe-a9f105e066fe'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:32 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:32 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:32 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de 1073741824" returned: 0 in 0.504s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:32 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de Nov 01 09:45:32 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:32 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.266s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Deleted volume successfully. Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4d90081-a7bb-42de-a7ab-cfbb977a3281 tempest-TestMinimumBasicScenario-1646824304 None] Lock "cinder-a12b1f04-a3c9-4e39-ada2-3020b93b09b0-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:32 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de" returned: 0 in 0.279s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a79a17-a184-40e0-ac20-fb230878768d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb39b92-715b-4827-8f7d-402f53cf22de', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde3c7d5-9e0e-4d3e-a2e2-c57d7c5d649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:32 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Volume volume-cfb39b92-715b-4827-8f7d-402f53cf22de (cfb39b92-715b-4827-8f7d-402f53cf22de): created successfully Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dde3c7d5-9e0e-4d3e-a2e2-c57d7c5d649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Flow 'volume_create_manager' (8fe44c43-41ef-4943-94a6-cd9a3ee27592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-532ec32a-0e90-44ef-b438-c5e147e31478 tempest-GroupsTest-124524329 None] Created volume successfully. Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Flow 'volume_create_manager' (bba8c8ca-295a-4e56-99d2-b4eb986836e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff55fded-4aec-4366-8f9c-8c7a4a4f3279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff55fded-4aec-4366-8f9c-8c7a4a4f3279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1841038929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0cf9c7b-8e71-4e29-8997-d1b7508b1dd9,host='devstack@QuobyteHD#QuobyteHD',id=411a314b-f448-4bf6-b707-99c5d1f3f496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59a6d58c7f84f33bffe795686d039b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:33Z,use_quota=True,user_id='9346c1d812c04eb3b85e6cb0f4620cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd2ae92d-6600-46e5-916c-8aee01180d0a),volume_type_id=dd2ae92d-6600-46e5-916c-8aee01180d0a)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd6d4e0-7df8-4e69-bf6f-9de12d409556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afd6d4e0-7df8-4e69-bf6f-9de12d409556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa3f379-743b-4cca-bdbe-4956d550bfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5aa3f379-743b-4cca-bdbe-4956d550bfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411a314b-f448-4bf6-b707-99c5d1f3f496', 'volume_name': 'volume-411a314b-f448-4bf6-b707-99c5d1f3f496', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afc8aa8-88e9-4200-8bce-7c1e6dbbbd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afc8aa8-88e9-4200-8bce-7c1e6dbbbd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ecb197-a6f3-44fd-a921-736dc573e2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:33 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Volume 411a314b-f448-4bf6-b707-99c5d1f3f496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411a314b-f448-4bf6-b707-99c5d1f3f496', 'volume_size': 1} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0cf9c7b-8e71-4e29-8997-d1b7508b1dd9,created_at=2026-11-01T08:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1841038929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0cf9c7b-8e71-4e29-8997-d1b7508b1dd9,host='devstack@QuobyteHD#QuobyteHD',id=411a314b-f448-4bf6-b707-99c5d1f3f496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c59a6d58c7f84f33bffe795686d039b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:33Z,use_quota=True,user_id='9346c1d812c04eb3b85e6cb0f4620cff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd2ae92d-6600-46e5-916c-8aee01180d0a),volume_type_id=dd2ae92d-6600-46e5-916c-8aee01180d0a)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Creating volume 411a314b-f448-4bf6-b707-99c5d1f3f496 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:45:33 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:45:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:33 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 1073741824 Nov 01 09:45:33 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:34 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 1073741824" returned: 0 in 0.595s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:34 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 Nov 01 09:45:34 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:34 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496" returned: 0 in 0.330s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ecb197-a6f3-44fd-a921-736dc573e2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411a314b-f448-4bf6-b707-99c5d1f3f496', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0907eb7-40a9-4a86-96fa-f43771392ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:34 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Volume volume-411a314b-f448-4bf6-b707-99c5d1f3f496 (411a314b-f448-4bf6-b707-99c5d1f3f496): created successfully Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0907eb7-40a9-4a86-96fa-f43771392ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Flow 'volume_create_manager' (bba8c8ca-295a-4e56-99d2-b4eb986836e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:34 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-abed215c-45dc-4bc1-b9b0-28e2d321cba5 tempest-GroupsTest-124524329 None] Created volume successfully. Nov 01 09:45:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Acquiring lock "cinder-fbf823bb-3598-47fc-bad8-283d42c60826-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Lock "cinder-fbf823bb-3598-47fc-bad8-283d42c60826-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Acquiring lock "cinder-quobyte-fbf823bb-3598-47fc-bad8-283d42c60826" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Lock "cinder-quobyte-fbf823bb-3598-47fc-bad8-283d42c60826" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[068884db-a84d-411d-8311-ad0e8202ecf2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:35 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 Nov 01 09:45:35 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ee306ea1-ce23-4a3d-9458-6fcfce5d202b tempest-GroupsTest-124524329 None] Update group completed successfully. Nov 01 09:45:36 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826" returned: 0 in 0.388s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:36 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826 Nov 01 09:45:36 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:36 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fbf823bb-3598-47fc-bad8-283d42c60826" returned: 0 in 0.283s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Lock "cinder-quobyte-fbf823bb-3598-47fc-bad8-283d42c60826" released by "delete_volume" :: held 0.716s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Created reservations ['82679e9f-d4c0-4dfb-94f6-188806f997eb', '8697dfa8-0d35-4fd4-a3c2-736879852977', 'dee3cdc5-7dc2-4f89-b41d-07e0a5ca76a9', '74d96aa1-a824-40c3-a878-f7d1e6ebdb4f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:36 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:36 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:36 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.260s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Deleted volume successfully. Nov 01 09:45:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-aca7b88a-cf28-4fe5-864e-d6e7060e6587 tempest-VolumesNegativeTest-1316424674 None] Lock "cinder-fbf823bb-3598-47fc-bad8-283d42c60826-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ca9adec5-c269-411d-b4db-02289ac2067e tempest-GroupsTest-124524329 None] Update group completed successfully. Nov 01 09:45:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Acquiring lock "cinder-quobyte-411a314b-f448-4bf6-b707-99c5d1f3f496" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Lock "cinder-quobyte-411a314b-f448-4bf6-b707-99c5d1f3f496" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[103bbafa-2b42-4d19-a25e-07977e06da5c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:39 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 Nov 01 09:45:39 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:39 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496" returned: 0 in 0.437s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:39 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496 Nov 01 09:45:39 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:39 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-411a314b-f448-4bf6-b707-99c5d1f3f496" returned: 0 in 0.288s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Lock "cinder-quobyte-411a314b-f448-4bf6-b707-99c5d1f3f496" released by "delete_volume" :: held 0.798s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Acquiring lock "cinder-quobyte-cfb39b92-715b-4827-8f7d-402f53cf22de" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Lock "cinder-quobyte-cfb39b92-715b-4827-8f7d-402f53cf22de" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fc7bf2-31b2-4812-85d9-c031cdce0f70]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:40 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de Nov 01 09:45:40 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:40 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de" returned: 0 in 0.543s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:40 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de Nov 01 09:45:40 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:40 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cfb39b92-715b-4827-8f7d-402f53cf22de" returned: 0 in 0.283s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Lock "cinder-quobyte-cfb39b92-715b-4827-8f7d-402f53cf22de" released by "delete_volume" :: held 0.933s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Created reservations ['4bafac9c-0a66-48e2-8063-2869dd310f12'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:41 devstack cinder-volume[86594]: WARNING cinder.quota [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1261457845 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1261457845, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:45:41 devstack cinder-volume[86594]: WARNING cinder.quota [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1261457845 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1261457845, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Created reservations ['da024003-8b0f-4f29-b3d4-564fa862822c', '2cf3b904-2428-44a2-9645-865055b56c56', 'd84aea5f-f17a-44f8-a1d0-94a7833e5fb8', '3393674a-3e62-47a7-bd88-a6df1b3678ca'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Created reservations ['f6072d5d-53e7-44ea-99af-3f698f55418f', '98749ba9-615a-4d0e-8c40-643e9ffa4f94', 'e4d1b7cb-9d81-4492-806b-83113c9cabff', 'f327f85c-b064-4c1b-9dc5-d732bf320736'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:41 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:41 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:41 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.288s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:41 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4976298e-168e-47d7-844f-56607ef0bab4 tempest-GroupsTest-124524329 None] Delete group completed successfully. Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Flow 'volume_create_manager' (5a2926b9-74a1-44bb-abce-a8d47d2e4671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfc9d69-1b70-4f48-a473-0a786130b2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfc9d69-1b70-4f48-a473-0a786130b2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-720758345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adf15f0-1646-4b0d-a6fb-28da38d0aed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c277ab0c15f5412b8ffd3c15f76ca0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:51Z,use_quota=True,user_id='23a23f526bf0460ca455b89419ac0cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb2157a-84cf-4a04-8ef1-47fb2c49720f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb2157a-84cf-4a04-8ef1-47fb2c49720f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3be8e5a-edd4-4a6d-8703-0c0d52489ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3be8e5a-edd4-4a6d-8703-0c0d52489ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0adf15f0-1646-4b0d-a6fb-28da38d0aed9', 'volume_name': 'volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9212b371-14a1-4d21-8d16-6e702bc5b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9212b371-14a1-4d21-8d16-6e702bc5b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb210488-6997-4b7a-803e-1a48db226649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:50 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9', 'volume_size': 1} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-720758345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0adf15f0-1646-4b0d-a6fb-28da38d0aed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c277ab0c15f5412b8ffd3c15f76ca0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:45:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:45:51Z,use_quota=True,user_id='23a23f526bf0460ca455b89419ac0cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Creating volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:45:50 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:45:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:50 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 1073741824 Nov 01 09:45:50 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:51 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 1073741824" returned: 0 in 0.560s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:51 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 Nov 01 09:45:51 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:51 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" returned: 0 in 0.294s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb210488-6997-4b7a-803e-1a48db226649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e872aa2a-a49c-4022-ab68-1c201d5dab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:45:51 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Volume volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 (0adf15f0-1646-4b0d-a6fb-28da38d0aed9): created successfully Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e872aa2a-a49c-4022-ab68-1c201d5dab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:45:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Flow 'volume_create_manager' (5a2926b9-74a1-44bb-abce-a8d47d2e4671) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:45:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-94e49c7d-9240-4610-a0a8-a593eac8298c tempest-SnapshotsActionsTest-86074750 None] Created volume successfully. Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Creating offline snapshot e5b60c6a-867a-428e-83e7-a7800df72321 of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa2f60-4e96-42e9-8a89-1ac0533ea86b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:53 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 Nov 01 09:45:53 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:53 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:45:53 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:53 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.361s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:45:53 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" returned: 0 in 0.473s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:53 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 1G Nov 01 09:45:53 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:54 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 1G" returned: 0 in 0.537s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:54 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:45:54 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:54 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.380s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:54 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 is being set with open permissions: ugo+rw Nov 01 09:45:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:54 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:45:54 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:54 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:54 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.info Nov 01 09:45:54 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:55 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.info" returned: 0 in 0.305s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:55 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.info is being set with open permissions: ugo+rw Nov 01 09:45:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:55 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.info Nov 01 09:45:55 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:55 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.info" returned: 0 in 0.325s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6575f8ac-a0d6-4ea0-9846-4c5d7e15b293 tempest-SnapshotsActionsTest-86074750 None] Create snapshot completed successfully Nov 01 09:45:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:45:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:45:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Creating offline snapshot 699e1082-da6a-40db-88b3-67c53e3ce125 of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:45:57 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f0f429-5244-4fe5-a42f-34d76d3ee82f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:57 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:45:57 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:57 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.437s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:45:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:57 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 1G Nov 01 09:45:57 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:58 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 1G" returned: 0 in 0.580s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:58 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 Nov 01 09:45:58 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:58 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:58 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 is being set with open permissions: ugo+rw Nov 01 09:45:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:58 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 Nov 01 09:45:58 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:58 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Nov 01 09:45:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125" returned: 0 in 0.325s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:45:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:45:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3f637c9c-7b0c-477d-8a69-18ae74760c96 tempest-SnapshotsActionsTest-86074750 None] Create snapshot completed successfully Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-699e1082-da6a-40db-88b3-67c53e3ce125-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-699e1082-da6a-40db-88b3-67c53e3ce125-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-quobyte-699e1082-da6a-40db-88b3-67c53e3ce125" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-699e1082-da6a-40db-88b3-67c53e3ce125" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Deleting offline snapshot 699e1082-da6a-40db-88b3-67c53e3ce125 of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] snapshot_file for this snap is: volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f43d884-ad79-49e5-b782-64745ae62b71]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:45:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:45:59 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 Nov 01 09:45:59 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:45:59 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125" returned: 0 in 0.447s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[712dcdc3-9356-43b7-a96a-76b9158742e9]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:00 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:00 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:00 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.426s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:00 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 Nov 01 09:46:00 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:00 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125" returned: 0 in 0.501s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:01 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125 Nov 01 09:46:01 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:01 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.699e1082-da6a-40db-88b3-67c53e3ce125" returned: 0 in 0.302s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-699e1082-da6a-40db-88b3-67c53e3ce125" released by "_delete_snapshot" :: held 1.823s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" released by "delete_snapshot" :: held 1.854s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:01 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Created reservations ['4df9d26a-5b60-4dac-a9bd-60abc412829b', '4b9c83de-ec91-470d-b16f-488098534f08', '4704c095-71a9-437b-b114-fadc364d0e7b', '442499bd-b7ed-484a-ad73-369cd0947c93'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:46:01 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Delete snapshot completed successfully. Nov 01 09:46:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5bd8503c-34c1-4d66-b6ee-fd7a62908cbe tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-699e1082-da6a-40db-88b3-67c53e3ce125-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Creating offline snapshot bfbddeb9-9072-47ce-8c2d-166b794753f7 of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:46:02 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba1cb71-f538-4b31-b9aa-8eeea51482f4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:02 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:02 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:02 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.437s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:02 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 1G Nov 01 09:46:02 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:02 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 1G" returned: 0 in 0.527s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:03 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 Nov 01 09:46:03 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:03 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7" returned: 0 in 0.421s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:03 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 is being set with open permissions: ugo+rw Nov 01 09:46:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:03 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 Nov 01 09:46:03 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:03 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7" returned: 0 in 0.303s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:03 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-84971093-a72d-4b8c-889d-101e95703d96 tempest-SnapshotsActionsTest-86074750 None] Create snapshot completed successfully Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-bfbddeb9-9072-47ce-8c2d-166b794753f7-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-bfbddeb9-9072-47ce-8c2d-166b794753f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-quobyte-bfbddeb9-9072-47ce-8c2d-166b794753f7" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-bfbddeb9-9072-47ce-8c2d-166b794753f7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Deleting offline snapshot bfbddeb9-9072-47ce-8c2d-166b794753f7 of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] snapshot_file for this snap is: volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[032bc67f-b076-4391-b5aa-522fb98b702f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:04 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 Nov 01 09:46:04 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:04 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7" returned: 0 in 0.438s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f25374-fda5-4562-a28d-f0760123a9ec]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:04 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:04 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:05 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.438s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:05 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 Nov 01 09:46:05 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:05 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7" returned: 0 in 0.492s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:05 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7 Nov 01 09:46:05 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:06 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.bfbddeb9-9072-47ce-8c2d-166b794753f7" returned: 0 in 0.289s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-bfbddeb9-9072-47ce-8c2d-166b794753f7" released by "_delete_snapshot" :: held 1.806s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" released by "delete_snapshot" :: held 1.830s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=86,cinder:INSERT=27,cinder:UPDATE=102,cinder:DELETE=4 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=83,cinder:INSERT=18,cinder:UPDATE=98,cinder:DELETE=9 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Created reservations ['cd18e7f2-781e-4162-82e9-a0232fa35fb3', 'd50d2b86-aacc-4fc5-856b-82115c75d491', '0b5666cd-d179-42ae-9766-d9ef6c6bfaca', '2c765426-fcf1-4906-a4bb-e5501dd456c7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:46:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Delete snapshot completed successfully. Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-41d557a7-8992-4da3-8336-05bce2e4d8b6 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-bfbddeb9-9072-47ce-8c2d-166b794753f7-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Creating offline snapshot 4d3802b3-fe23-435a-be34-b045a67d0e54 of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7503f74-c14a-47b0-b32c-e889814d9882]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:06 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:06 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:07 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.434s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:07 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 1G Nov 01 09:46:07 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:07 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 1G" returned: 0 in 0.615s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:07 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 Nov 01 09:46:07 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:08 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54" returned: 0 in 0.334s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:08 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 is being set with open permissions: ugo+rw Nov 01 09:46:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:08 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 Nov 01 09:46:08 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:08 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:08 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7742d298-9e85-4fad-9eef-52ea0bad1594 tempest-SnapshotsActionsTest-86074750 None] Create snapshot completed successfully Nov 01 09:46:08 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:46:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Flow 'volume_create_manager' (467b3a99-6b4a-4725-adaa-b2fd8e57f9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e25da2b-41c9-4d43-84ae-c43fd4786a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e25da2b-41c9-4d43-84ae-c43fd4786a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1433952491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb22465-1e0b-4548-b6d7-c91ae973c535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba36e626ba604bf8a30e13adaab00d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:46:09Z,use_quota=True,user_id='281ae31107ba4cb3affce88972d815fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb60182d-e574-4b51-b859-3f2e0df5aca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb60182d-e574-4b51-b859-3f2e0df5aca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311011cb-ce29-4385-834b-579ec7bab397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (311011cb-ce29-4385-834b-579ec7bab397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb22465-1e0b-4548-b6d7-c91ae973c535', 'volume_name': 'volume-4fb22465-1e0b-4548-b6d7-c91ae973c535', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2c5fa5-020e-473a-946f-9ff497aad792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca2c5fa5-020e-473a-946f-9ff497aad792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105260a5-83f4-4382-b07c-e71aad45c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Volume 4fb22465-1e0b-4548-b6d7-c91ae973c535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb22465-1e0b-4548-b6d7-c91ae973c535', 'volume_size': 1} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:46:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1433952491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb22465-1e0b-4548-b6d7-c91ae973c535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba36e626ba604bf8a30e13adaab00d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:46:09Z,use_quota=True,user_id='281ae31107ba4cb3affce88972d815fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Creating volume 4fb22465-1e0b-4548-b6d7-c91ae973c535 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:46:09 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:09 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 1073741824 Nov 01 09:46:09 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-4d3802b3-fe23-435a-be34-b045a67d0e54-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-4d3802b3-fe23-435a-be34-b045a67d0e54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-quobyte-4d3802b3-fe23-435a-be34-b045a67d0e54" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-4d3802b3-fe23-435a-be34-b045a67d0e54" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Deleting offline snapshot 4d3802b3-fe23-435a-be34-b045a67d0e54 of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] snapshot_file for this snap is: volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4048a2db-6740-4902-b378-28b59649c6ec]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:09 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 Nov 01 09:46:09 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Flow 'volume_create_manager' (3a7b23cc-1ff5-417d-bfb8-7c2815779d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6d87d6-82d9-4bfe-a982-c4df190f294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6d87d6-82d9-4bfe-a982-c4df190f294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-727981743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b21cafc-8b5b-4a40-a90e-a0a4e50686b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba36e626ba604bf8a30e13adaab00d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:46:09Z,use_quota=True,user_id='281ae31107ba4cb3affce88972d815fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25934213-ee8e-4859-aac6-618653fe9aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25934213-ee8e-4859-aac6-618653fe9aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a44f3d-b5c8-43c4-8df3-247373343fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a44f3d-b5c8-43c4-8df3-247373343fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b21cafc-8b5b-4a40-a90e-a0a4e50686b6', 'volume_name': 'volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4eb4f42-138c-4ab1-b461-9d7a409e5ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4eb4f42-138c-4ab1-b461-9d7a409e5ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3314ab-b69b-407e-85ca-6b88deaf8263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Volume 6b21cafc-8b5b-4a40-a90e-a0a4e50686b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6', 'volume_size': 1} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:09 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 1073741824" returned: 0 in 0.726s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:09 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 Nov 01 09:46:09 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:09 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54" returned: 0 in 0.664s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e66ba1-01ab-426f-9b54-a11d6c1a4c82]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:10 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:10 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:10 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535" returned: 0 in 0.345s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-727981743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b21cafc-8b5b-4a40-a90e-a0a4e50686b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba36e626ba604bf8a30e13adaab00d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:46:09Z,use_quota=True,user_id='281ae31107ba4cb3affce88972d815fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Creating volume 6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:46:10 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105260a5-83f4-4382-b07c-e71aad45c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb22465-1e0b-4548-b6d7-c91ae973c535', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de690f0-f1fc-4606-b22d-92b3ad34fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:10 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 1073741824 Nov 01 09:46:10 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:10 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Volume volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 (4fb22465-1e0b-4548-b6d7-c91ae973c535): created successfully Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de690f0-f1fc-4606-b22d-92b3ad34fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Flow 'volume_create_manager' (467b3a99-6b4a-4725-adaa-b2fd8e57f9f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:46:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e30ed730-b52d-4ca9-9dc0-7d9e3cc1e335 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Created volume successfully. Nov 01 09:46:10 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.582s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:10 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 Nov 01 09:46:10 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:10 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 1073741824" returned: 0 in 0.691s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:11 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 Nov 01 09:46:11 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:11 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54" returned: 0 in 0.537s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:11 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54 Nov 01 09:46:11 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:11 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6" returned: 0 in 0.387s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da3314ab-b69b-407e-85ca-6b88deaf8263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb14dd4-a43c-47e2-ba6e-c3fc5d3465ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:11 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Volume volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 (6b21cafc-8b5b-4a40-a90e-a0a4e50686b6): created successfully Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb14dd4-a43c-47e2-ba6e-c3fc5d3465ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Flow 'volume_create_manager' (3a7b23cc-1ff5-417d-bfb8-7c2815779d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:46:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5b8e0f20-5693-4e7d-9292-733232a6a33e tempest-TestServerVolumeAttachmentScenario-1087675142 None] Created volume successfully. Nov 01 09:46:11 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.4d3802b3-fe23-435a-be34-b045a67d0e54" returned: 0 in 0.390s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-4d3802b3-fe23-435a-be34-b045a67d0e54" released by "_delete_snapshot" :: held 2.349s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" released by "delete_snapshot" :: held 2.386s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Created reservations ['0cdecd0b-7867-4d5b-9fe3-7ba0af91e96a', '83c32110-d1ad-45ca-8fc1-8955002229e3', 'dde34f74-57d8-476c-abe6-a48f4098089a', 'e9723114-4946-4ed4-9427-43439cd5877e'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:46:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Delete snapshot completed successfully. Nov 01 09:46:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-56202a26-3a45-44b7-af9b-af18657db8bb tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-4d3802b3-fe23-435a-be34-b045a67d0e54-delete_snapshot" released by "delete_snapshot" :: held 2.563s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Creating offline snapshot e8a4641c-8863-48f4-85a6-a97f1edf010b of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:46:12 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[306930b9-c390-4837-8176-8b56ab99547a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:13 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:13 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:13 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.481s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:13 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b 1G Nov 01 09:46:13 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:13 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b 1G" returned: 0 in 0.547s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:13 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b Nov 01 09:46:13 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:14 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b" returned: 0 in 0.394s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:14 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b is being set with open permissions: ugo+rw Nov 01 09:46:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:14 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b Nov 01 09:46:14 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:14 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b" returned: 0 in 0.366s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bff253b0-c754-4371-b043-6e3f9ec1e60f tempest-SnapshotsActionsTest-86074750 None] Create snapshot completed successfully Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-e8a4641c-8863-48f4-85a6-a97f1edf010b-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-e8a4641c-8863-48f4-85a6-a97f1edf010b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Acquiring lock "cinder-quobyte-e8a4641c-8863-48f4-85a6-a97f1edf010b" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-e8a4641c-8863-48f4-85a6-a97f1edf010b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Deleting offline snapshot e8a4641c-8863-48f4-85a6-a97f1edf010b of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] snapshot_file for this snap is: volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a269ce-c9d9-4775-b19e-eb40d4ba22ee]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:15 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b Nov 01 09:46:15 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:15 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b" returned: 0 in 0.426s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a870cea-a71e-4182-994c-63f1711bc3e3]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:15 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:15 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:16 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.418s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:16 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b Nov 01 09:46:16 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:16 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b" returned: 0 in 0.552s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:16 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b Nov 01 09:46:16 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:17 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e8a4641c-8863-48f4-85a6-a97f1edf010b" returned: 0 in 0.277s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-e8a4641c-8863-48f4-85a6-a97f1edf010b" released by "_delete_snapshot" :: held 1.821s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" released by "delete_snapshot" :: held 1.859s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:17 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Created reservations ['fd50a3b9-0297-46c4-9d20-d8b672b92033', 'bc1acbef-c01e-41a9-b686-549ed63df718', '0d6c867f-e17e-4513-b9c1-77cb96c8a5f9', '08e39917-a5c0-4006-9657-d1feca46f9d4'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:46:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Delete snapshot completed successfully. Nov 01 09:46:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-090e9eca-d9fd-46c6-bc1a-8d1e6972a2c7 tempest-SnapshotsActionsTest-750321817 None] Lock "cinder-e8a4641c-8863-48f4-85a6-a97f1edf010b-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "cinder-e5b60c6a-867a-428e-83e7-a7800df72321-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-e5b60c6a-867a-428e-83e7-a7800df72321-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "cinder-quobyte-e5b60c6a-867a-428e-83e7-a7800df72321" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-quobyte-e5b60c6a-867a-428e-83e7-a7800df72321" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Deleting offline snapshot e5b60c6a-867a-428e-83e7-a7800df72321 of volume 0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] snapshot_file for this snap is: volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[046d786e-a019-4065-9d00-0330df804b99]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:19 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:19 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:19 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.530s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:46:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c35980d-7f95-43a1-a6bb-3b8d22e553b7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:19 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 Nov 01 09:46:19 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:19 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" returned: 0 in 0.525s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:19 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:19 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:20 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.369s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:20 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321 Nov 01 09:46:20 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:20 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9.e5b60c6a-867a-428e-83e7-a7800df72321" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-quobyte-e5b60c6a-867a-428e-83e7-a7800df72321" released by "_delete_snapshot" :: held 1.900s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" released by "delete_snapshot" :: held 1.931s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:20 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Created reservations ['cd3ea424-a838-48c7-ac56-31a85ea408a4', 'd4cc4ffc-4e05-4c6f-99ff-bbab0c3edd72', '258547f4-86a8-4319-b991-4bb3e673a8cf', '0a1128fb-8c5f-4189-b0b1-5f0e37c67dd7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:46:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Delete snapshot completed successfully. Nov 01 09:46:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98cdb54e-4c26-431b-a9c9-854de80ef865 tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-e5b60c6a-867a-428e-83e7-a7800df72321-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "cinder-0adf15f0-1646-4b0d-a6fb-28da38d0aed9-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-0adf15f0-1646-4b0d-a6fb-28da38d0aed9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:21 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ce185-0601-4f01-90c3-ef61f501da0e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:21 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 Nov 01 09:46:21 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:21 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" returned: 0 in 0.433s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:21 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9 Nov 01 09:46:21 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:22 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" returned: 0 in 0.405s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-quobyte-0adf15f0-1646-4b0d-a6fb-28da38d0aed9" released by "delete_volume" :: held 0.952s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Created reservations ['8b18b397-a602-4dd7-8763-83816f4ec949', 'e5da50ab-64c0-4f27-845d-56cd02b591b1', '89b5cf64-e48a-4608-a1ba-cb91ceeec9b8', 'ac69a988-4d8b-40e9-b4d8-7d3ac8ae9908'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:22 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:46:22 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:22 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.373s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:46:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Deleted volume successfully. Nov 01 09:46:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1aa68808-1e35-4c52-a309-3623c23c748b tempest-SnapshotsActionsTest-86074750 None] Lock "cinder-0adf15f0-1646-4b0d-a6fb-28da38d0aed9-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Flow 'volume_create_manager' (b9a475fa-d1f9-403a-b8aa-91dfc0108b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94c4daa-caa3-4d6c-988b-231712b8f22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94c4daa-caa3-4d6c-988b-231712b8f22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1821679178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2b86f3-f780-42ba-8be9-2e56b3992120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc3ac5659b41eda1af824fe2882ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:46:37Z,use_quota=True,user_id='2f7589ab19ce465188def431cff85a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9278d07-1f0e-4267-9024-f5fdd16e49d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9278d07-1f0e-4267-9024-f5fdd16e49d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616da08b-55ee-473e-9b18-20ed5172bdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616da08b-55ee-473e-9b18-20ed5172bdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2b86f3-f780-42ba-8be9-2e56b3992120', 'volume_name': 'volume-6c2b86f3-f780-42ba-8be9-2e56b3992120', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c35f23-5b88-44c4-9771-80e89cfc041e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c35f23-5b88-44c4-9771-80e89cfc041e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18361197-3808-43d8-bbbb-42f0a25f2c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:37 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Volume 6c2b86f3-f780-42ba-8be9-2e56b3992120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2b86f3-f780-42ba-8be9-2e56b3992120', 'volume_size': 1} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1821679178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2b86f3-f780-42ba-8be9-2e56b3992120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bc3ac5659b41eda1af824fe2882ee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:46:37Z,use_quota=True,user_id='2f7589ab19ce465188def431cff85a68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Creating volume 6c2b86f3-f780-42ba-8be9-2e56b3992120 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:46:37 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:46:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:37 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 1073741824 Nov 01 09:46:37 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:38 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 1073741824" returned: 0 in 0.432s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:38 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 Nov 01 09:46:38 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:38 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120" returned: 0 in 0.270s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18361197-3808-43d8-bbbb-42f0a25f2c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2b86f3-f780-42ba-8be9-2e56b3992120', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9464ee-a848-4004-a3ba-ab9427d89a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:38 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Volume volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 (6c2b86f3-f780-42ba-8be9-2e56b3992120): created successfully Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d9464ee-a848-4004-a3ba-ab9427d89a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Flow 'volume_create_manager' (b9a475fa-d1f9-403a-b8aa-91dfc0108b55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:46:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d19b05ae-3cbb-47cc-b5cf-84bdb151b849 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Created volume successfully. Nov 01 09:46:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Acquiring lock "cinder-6c2b86f3-f780-42ba-8be9-2e56b3992120-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "cinder-6c2b86f3-f780-42ba-8be9-2e56b3992120-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Acquiring lock "cinder-quobyte-6c2b86f3-f780-42ba-8be9-2e56b3992120" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "cinder-quobyte-6c2b86f3-f780-42ba-8be9-2e56b3992120" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[22edf8ed-27b6-4158-bc1f-ee7d392f5f5a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:40 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 Nov 01 09:46:40 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:40 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120" returned: 0 in 0.430s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:40 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120 Nov 01 09:46:40 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:40 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6c2b86f3-f780-42ba-8be9-2e56b3992120" returned: 0 in 0.313s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "cinder-quobyte-6c2b86f3-f780-42ba-8be9-2e56b3992120" released by "delete_volume" :: held 0.797s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Created reservations ['249ff8b5-bcd0-4614-b677-eaab3e58e94d', '5072dc39-b138-4ede-a783-b223cf59dfc7', 'cb03d278-8228-478a-af5a-545e6e1aa1ed', '06581a6e-9958-4da6-8a7f-45c394a91c60'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:40 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:46:40 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:41 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.297s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:41 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:46:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Deleted volume successfully. Nov 01 09:46:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c563de2-0656-48ef-b4f8-5ef3384044f8 tempest-VolumeQuotasNegativeTestJSON-1214825833 None] Lock "cinder-6c2b86f3-f780-42ba-8be9-2e56b3992120-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:46:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-e988ca5e-8776-402d-8df3-019682e7ae1f req-28251804-927f-4e93-ac7b-7ee6f79ffdd0 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-e988ca5e-8776-402d-8df3-019682e7ae1f req-28251804-927f-4e93-ac7b-7ee6f79ffdd0 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-e988ca5e-8776-402d-8df3-019682e7ae1f req-28251804-927f-4e93-ac7b-7ee6f79ffdd0 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-e988ca5e-8776-402d-8df3-019682e7ae1f req-28251804-927f-4e93-ac7b-7ee6f79ffdd0 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-4fb22465-1e0b-4548-b6d7-c91ae973c535', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b243a3b7-4974-4ac9-a57f-a00f52c8cf21', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:46:44 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-e988ca5e-8776-402d-8df3-019682e7ae1f req-28251804-927f-4e93-ac7b-7ee6f79ffdd0 tempest-TestServerVolumeAttachmentScenario-1087675142 None] attachment_update completed successfully. Nov 01 09:46:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1d45358c-1378-42f9-bd61-eb036c643c9e req-a93cc496-0992-4c4d-a4a5-a7a0344885c7 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1d45358c-1378-42f9-bd61-eb036c643c9e req-a93cc496-0992-4c4d-a4a5-a7a0344885c7 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-1d45358c-1378-42f9-bd61-eb036c643c9e req-a93cc496-0992-4c4d-a4a5-a7a0344885c7 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-1d45358c-1378-42f9-bd61-eb036c643c9e req-a93cc496-0992-4c4d-a4a5-a7a0344885c7 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a657e01-fb6c-4336-bfc4-5e169fe05b08', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:46:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-1d45358c-1378-42f9-bd61-eb036c643c9e req-a93cc496-0992-4c4d-a4a5-a7a0344885c7 tempest-TestServerVolumeAttachmentScenario-1087675142 None] attachment_update completed successfully. Nov 01 09:46:52 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-f68542df-f7b7-406b-8598-051889ecab13 req-676fb8e4-09a2-42bf-8d8f-f4ee6a98274c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Terminate volume connection completed successfully. Nov 01 09:46:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-f68542df-f7b7-406b-8598-051889ecab13 req-676fb8e4-09a2-42bf-8d8f-f4ee6a98274c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Deleting attachment 6a657e01-fb6c-4336-bfc4-5e169fe05b08. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:53 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:46:53 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Flow 'volume_create_manager' (a297a26c-e5b2-4be4-9b5f-c69c88f5d5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6900a72-2a5e-4851-abc7-889fc490662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6900a72-2a5e-4851-abc7-889fc490662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-699913006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3183d216-51cf-43ba-966b-f4261914ef99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45eb272794274363bfdbb079e2cbf7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:46:53Z,use_quota=True,user_id='9bd9a23df08a4a4ba5516a75afd730d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba0f959-5ed1-4111-9888-ff7b2be3d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba0f959-5ed1-4111-9888-ff7b2be3d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17eb7cc9-4bf3-4fd1-a6ff-38bd7781133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17eb7cc9-4bf3-4fd1-a6ff-38bd7781133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3183d216-51cf-43ba-966b-f4261914ef99', 'volume_name': 'volume-3183d216-51cf-43ba-966b-f4261914ef99', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e35f72a-86b1-4d84-8683-d73f915a2524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e35f72a-86b1-4d84-8683-d73f915a2524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d13dc6-e863-43b5-af30-36fb49d015d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:53 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Volume 3183d216-51cf-43ba-966b-f4261914ef99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3183d216-51cf-43ba-966b-f4261914ef99', 'volume_size': 1} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-699913006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3183d216-51cf-43ba-966b-f4261914ef99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45eb272794274363bfdbb079e2cbf7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:46:53Z,use_quota=True,user_id='9bd9a23df08a4a4ba5516a75afd730d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Creating volume 3183d216-51cf-43ba-966b-f4261914ef99 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:46:53 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:53 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.349s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:46:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:46:53 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 1073741824 Nov 01 09:46:53 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:54 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 1073741824" returned: 0 in 0.567s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:54 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-4f7798a2-160f-41d4-ab9d-10d9425d4188 req-b5d5c15b-96bc-4700-92c2-c91325232498 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Terminate volume connection completed successfully. Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-4f7798a2-160f-41d4-ab9d-10d9425d4188 req-b5d5c15b-96bc-4700-92c2-c91325232498 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Deleting attachment b243a3b7-4974-4ac9-a57f-a00f52c8cf21. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:46:54 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 Nov 01 09:46:54 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:46:54 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d13dc6-e863-43b5-af30-36fb49d015d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3183d216-51cf-43ba-966b-f4261914ef99', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e5f97e-1874-410f-ab77-d6cacc688b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:46:54 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Volume volume-3183d216-51cf-43ba-966b-f4261914ef99 (3183d216-51cf-43ba-966b-f4261914ef99): created successfully Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e5f97e-1874-410f-ab77-d6cacc688b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:46:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Flow 'volume_create_manager' (a297a26c-e5b2-4be4-9b5f-c69c88f5d5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:46:54 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e7c605bb-a2b6-4f63-9e50-25a0f2f830ea tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Created volume successfully. Nov 01 09:46:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-5dddd580-3a3d-449e-80ef-5bd0a82acfd7 req-305e0952-96b9-4126-a962-671d4fb69914 tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:46:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-5dddd580-3a3d-449e-80ef-5bd0a82acfd7 req-305e0952-96b9-4126-a962-671d4fb69914 tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:46:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-5dddd580-3a3d-449e-80ef-5bd0a82acfd7 req-305e0952-96b9-4126-a962-671d4fb69914 tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:46:56 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-5dddd580-3a3d-449e-80ef-5bd0a82acfd7 req-305e0952-96b9-4126-a962-671d4fb69914 tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-3183d216-51cf-43ba-966b-f4261914ef99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96204f7a-6783-4118-81e5-1db59e40eee3', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:46:56 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-5dddd580-3a3d-449e-80ef-5bd0a82acfd7 req-305e0952-96b9-4126-a962-671d4fb69914 tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] attachment_update completed successfully. Nov 01 09:47:00 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-89ccfd59-bf89-44fa-9d54-822f9e31d895 req-d581302d-dab3-4591-bf1a-73d69e093281 tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Terminate volume connection completed successfully. Nov 01 09:47:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-89ccfd59-bf89-44fa-9d54-822f9e31d895 req-d581302d-dab3-4591-bf1a-73d69e093281 tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Deleting attachment 96204f7a-6783-4118-81e5-1db59e40eee3. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Acquiring lock "cinder-3183d216-51cf-43ba-966b-f4261914ef99-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "cinder-3183d216-51cf-43ba-966b-f4261914ef99-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Acquiring lock "cinder-quobyte-3183d216-51cf-43ba-966b-f4261914ef99" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "cinder-quobyte-3183d216-51cf-43ba-966b-f4261914ef99" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23da7d9-1395-4761-8b81-1ad934ba306e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:01 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 Nov 01 09:47:01 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "cinder-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "cinder-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "cinder-quobyte-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "cinder-quobyte-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5a567-1a61-40ce-a7b2-621b7a89dacc]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:01 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 Nov 01 09:47:01 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:01 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99" returned: 0 in 0.530s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:02 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99 Nov 01 09:47:02 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:02 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6" returned: 0 in 0.460s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:02 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:02 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6 Nov 01 09:47:02 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3183d216-51cf-43ba-966b-f4261914ef99" returned: 0 in 0.323s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "cinder-quobyte-3183d216-51cf-43ba-966b-f4261914ef99" released by "delete_volume" :: held 0.919s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Created reservations ['fc96eba5-ba01-4310-90b7-e2da0ad81ce4', '1ed077b4-5510-497a-ad54-4f48324694af', 'e1912c05-bdfa-4c0b-a2f4-c41a09f47c72', '3e2c120f-0561-401e-bdf2-956b42e23841'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:02 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:02 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:02 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6" returned: 0 in 0.337s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "cinder-quobyte-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6" released by "delete_volume" :: held 0.869s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Created reservations ['53940729-4f06-4e51-94fa-fe8f3ebc9cac', 'f760fe56-6119-4777-8a60-35602696109c', '6a089dd8-6423-42c3-87cc-56aac36ba65c', '07a0ac6b-58a5-435c-b01c-66e7f06c2a4e'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:02 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.442s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:02 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Deleted volume successfully. Nov 01 09:47:02 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:02 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-247c76c4-c54b-42cd-99c2-b03fb0746f5a tempest-TestServerVolumeAttachScenarioOldVersion-178442343 None] Lock "cinder-3183d216-51cf-43ba-966b-f4261914ef99-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "cinder-4fb22465-1e0b-4548-b6d7-c91ae973c535-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "cinder-4fb22465-1e0b-4548-b6d7-c91ae973c535-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "cinder-quobyte-4fb22465-1e0b-4548-b6d7-c91ae973c535" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "cinder-quobyte-4fb22465-1e0b-4548-b6d7-c91ae973c535" acquired by "delete_volume" :: waited 0.069s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[628455b7-474a-4ace-b4c6-99ac8824935f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:03 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 Nov 01 09:47:03 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:03 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.573s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:03 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Deleted volume successfully. Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b03b5b02-a381-4891-ae75-a1abf07344c3 tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "cinder-6b21cafc-8b5b-4a40-a90e-a0a4e50686b6-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:03 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535" returned: 0 in 0.467s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:03 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535 Nov 01 09:47:03 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:04 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb22465-1e0b-4548-b6d7-c91ae973c535" returned: 0 in 0.309s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "cinder-quobyte-4fb22465-1e0b-4548-b6d7-c91ae973c535" released by "delete_volume" :: held 0.900s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Created reservations ['75f2e7dc-43c3-44db-9308-4ecd337d363d', 'd224ba85-4bb8-436e-aa36-6b5fb8af48ce', '2995583d-3b51-4a8d-96ea-ef5c0cf3aafa', 'dedb5029-fb85-42cc-8ed8-455277b1f3c3'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:04 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:04 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:04 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.313s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:04 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Deleted volume successfully. Nov 01 09:47:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-82dfacda-7041-46d6-9712-7d4c36bd6c5c tempest-TestServerVolumeAttachmentScenario-1087675142 None] Lock "cinder-4fb22465-1e0b-4548-b6d7-c91ae973c535-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:14 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=76,cinder:INSERT=15,cinder:UPDATE=86,cinder:DELETE=5 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:47:14 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=82,cinder:INSERT=25,cinder:UPDATE=76,cinder:DELETE=6 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (4874eb29-85a0-4ecd-8756-592cf1671a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aad63f6-7096-4328-82b5-13f0fa85c58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aad63f6-7096-4328-82b5-13f0fa85c58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1615606463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc86f37-4ffc-44f5-9816-efea7dda9bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:22Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d802b2-b7c0-447a-b471-13f1bd60cb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d802b2-b7c0-447a-b471-13f1bd60cb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f6e1b4-37c2-4948-81ca-f291e736c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08f6e1b4-37c2-4948-81ca-f291e736c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc86f37-4ffc-44f5-9816-efea7dda9bb7', 'volume_name': 'volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ccc221-0b5a-4f84-891e-553657512720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5ccc221-0b5a-4f84-891e-553657512720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e0b980-e4e7-4def-8b3c-03bdc287f833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:22 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Volume 5dc86f37-4ffc-44f5-9816-efea7dda9bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7', 'volume_size': 1} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1615606463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc86f37-4ffc-44f5-9816-efea7dda9bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:22Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Creating volume 5dc86f37-4ffc-44f5-9816-efea7dda9bb7 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:22 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:22 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 1073741824 Nov 01 09:47:22 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (87634500-b3f2-48f3-8cee-c03e8b6aebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e8a084-f49c-4fae-82f5-3946ac463d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e8a084-f49c-4fae-82f5-3946ac463d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-845334320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34d36da-6e84-4e3e-83e5-53119b7289b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:23Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa822399-a8e0-4660-b13d-9f3ff9bdff4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa822399-a8e0-4660-b13d-9f3ff9bdff4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fa4a5c-995b-408e-8b60-d191b5fb3464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fa4a5c-995b-408e-8b60-d191b5fb3464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34d36da-6e84-4e3e-83e5-53119b7289b4', 'volume_name': 'volume-d34d36da-6e84-4e3e-83e5-53119b7289b4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf1f103-aaed-4d86-b5a1-50f53f92f906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:23 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf1f103-aaed-4d86-b5a1-50f53f92f906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2c5a63-894e-429e-a3bd-ad30adc363a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Volume d34d36da-6e84-4e3e-83e5-53119b7289b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34d36da-6e84-4e3e-83e5-53119b7289b4', 'volume_size': 1} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 1073741824" returned: 0 in 0.967s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:23 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 Nov 01 09:47:23 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:24 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (0e0cc864-759c-449e-9f7c-aa131343dee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb39b90-6bb9-46d2-8151-505d727332c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7" returned: 0 in 0.597s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-845334320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34d36da-6e84-4e3e-83e5-53119b7289b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:23Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Creating volume d34d36da-6e84-4e3e-83e5-53119b7289b4 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:24 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fb39b90-6bb9-46d2-8151-505d727332c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150385325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:24Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:24 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 1073741824 Nov 01 09:47:24 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ae1308-9088-4e83-aafe-3c2a02f9d6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ae1308-9088-4e83-aafe-3c2a02f9d6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db25d861-2fc7-47c6-a200-9847555c4809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db25d861-2fc7-47c6-a200-9847555c4809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad', 'volume_name': 'volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a759a7-36da-427a-9de6-c1f19e83e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a759a7-36da-427a-9de6-c1f19e83e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a925d71-cc29-48f9-825d-7afd458fb700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:24 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Volume 12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad', 'volume_size': 1} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e0b980-e4e7-4def-8b3c-03bdc287f833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff692a1b-b9d7-4fbe-b2ea-f9a72b5573b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:24 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Volume volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 (5dc86f37-4ffc-44f5-9816-efea7dda9bb7): created successfully Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff692a1b-b9d7-4fbe-b2ea-f9a72b5573b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (4874eb29-85a0-4ecd-8756-592cf1671a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:24 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fa1f9eb3-7d25-4f70-89ab-c12c96a55bdd tempest-CreateVolumesFromImageTest-1665163195 None] Created volume successfully. Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (3f44af87-f4f1-4450-bc4d-644e0f7d5c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f392d927-0b33-4dd0-a0b2-ccd9cd70db07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:25 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 1073741824" returned: 0 in 0.922s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f392d927-0b33-4dd0-a0b2-ccd9cd70db07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1750062587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16dc1221-be4a-40ff-b5dd-e69be10d3a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:25Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233f2695-1f0d-4fbe-956a-ddaa9ac45758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (233f2695-1f0d-4fbe-956a-ddaa9ac45758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ec1727-b9db-4c14-b3d8-8983a5fdfa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82ec1727-b9db-4c14-b3d8-8983a5fdfa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16dc1221-be4a-40ff-b5dd-e69be10d3a06', 'volume_name': 'volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002e6fba-f945-47a2-be03-4a362bbcc820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002e6fba-f945-47a2-be03-4a362bbcc820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fe35e9-adc8-4726-bdd0-f94285d9930d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:25 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Volume 16dc1221-be4a-40ff-b5dd-e69be10d3a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06', 'volume_size': 1} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:25 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 Nov 01 09:47:25 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:26 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4" returned: 0 in 0.519s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150385325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:24Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Creating volume 12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:26 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:26 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad 1073741824 Nov 01 09:47:26 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2c5a63-894e-429e-a3bd-ad30adc363a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34d36da-6e84-4e3e-83e5-53119b7289b4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd75b7a-aa09-4683-ad02-fa38fc5bc4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Volume volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 (d34d36da-6e84-4e3e-83e5-53119b7289b4): created successfully Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fd75b7a-aa09-4683-ad02-fa38fc5bc4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (87634500-b3f2-48f3-8cee-c03e8b6aebcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (04ffdd7e-02c8-4720-bd98-902ed0adf8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12e860f-e33b-4bd4-ae45-27cbc76ff0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d519d123-f032-4e5d-a863-a15f85b255ab tempest-CreateVolumesFromImageTest-1665163195 None] Created volume successfully. Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12e860f-e33b-4bd4-ae45-27cbc76ff0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692579673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09dae427-3157-4c21-a6b0-4340ecce26aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:26Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586591b9-ed12-439a-b146-312f3ca330cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586591b9-ed12-439a-b146-312f3ca330cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3068444-61b3-495e-93d9-e97a34cf277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3068444-61b3-495e-93d9-e97a34cf277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09dae427-3157-4c21-a6b0-4340ecce26aa', 'volume_name': 'volume-09dae427-3157-4c21-a6b0-4340ecce26aa', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3486d480-82dd-4b80-9eaa-346bd6d1f1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3486d480-82dd-4b80-9eaa-346bd6d1f1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe39e293-0791-421a-8f96-0707ab0f5f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Volume 09dae427-3157-4c21-a6b0-4340ecce26aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09dae427-3157-4c21-a6b0-4340ecce26aa', 'volume_size': 1} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (f9685d45-0a14-4d45-b93e-cfc718c2f28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d629277-56ef-4770-aa26-c1fa43981ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d629277-56ef-4770-aa26-c1fa43981ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-556396410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cdcd62-adb7-40ab-9b09-abf453bf29c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:27Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e098f7-cc9f-4a73-a232-696864fa5a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e098f7-cc9f-4a73-a232-696864fa5a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c163d7a-f820-4bd6-8895-308c5c51f39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c163d7a-f820-4bd6-8895-308c5c51f39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00cdcd62-adb7-40ab-9b09-abf453bf29c8', 'volume_name': 'volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bc7003-be3d-4f66-94ce-b4d3c4f7fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41bc7003-be3d-4f66-94ce-b4d3c4f7fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0a2a3a-1948-4a2c-bce2-00cb6d831fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:26 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Volume 00cdcd62-adb7-40ab-9b09-abf453bf29c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8', 'volume_size': 1} Nov 01 09:47:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:27 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad 1073741824" returned: 0 in 0.870s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:27 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad Nov 01 09:47:27 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:27 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad" returned: 0 in 0.288s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.818s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1750062587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16dc1221-be4a-40ff-b5dd-e69be10d3a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:25Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Creating volume 16dc1221-be4a-40ff-b5dd-e69be10d3a06 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:27 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:27 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 1073741824 Nov 01 09:47:27 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a925d71-cc29-48f9-825d-7afd458fb700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7173b8e4-55f1-41b9-b01f-c31a3d11188a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:27 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Volume volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad (12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad): created successfully Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7173b8e4-55f1-41b9-b01f-c31a3d11188a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (0e0cc864-759c-449e-9f7c-aa131343dee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b969bb6f-d0ac-4c94-acdf-00404dce0185 tempest-CreateVolumesFromImageTest-1665163195 None] Created volume successfully. Nov 01 09:47:27 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 1073741824" returned: 0 in 0.505s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:27 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 Nov 01 09:47:27 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:28 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692579673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09dae427-3157-4c21-a6b0-4340ecce26aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22958334cbad4dc08d7f7dd05b740be6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:26Z,use_quota=True,user_id='fbeb02ecdb0344dbb5b49691e6b1d564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Creating volume 09dae427-3157-4c21-a6b0-4340ecce26aa {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:28 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10fe35e9-adc8-4726-bdd0-f94285d9930d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124586f6-1304-46b6-b89d-557a6827539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:28 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa 1073741824 Nov 01 09:47:28 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Volume volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 (16dc1221-be4a-40ff-b5dd-e69be10d3a06): created successfully Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124586f6-1304-46b6-b89d-557a6827539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (3f44af87-f4f1-4450-bc4d-644e0f7d5c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a5a78d70-1d5d-491e-9eaa-e239f19ddbec tempest-CreateVolumesFromImageTest-1665163195 None] Created volume successfully. Nov 01 09:47:28 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa 1073741824" returned: 0 in 0.592s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:28 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa Nov 01 09:47:28 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:29 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa" returned: 0 in 0.269s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.266s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-556396410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00cdcd62-adb7-40ab-9b09-abf453bf29c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:27Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Creating volume 00cdcd62-adb7-40ab-9b09-abf453bf29c8 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:29 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe39e293-0791-421a-8f96-0707ab0f5f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09dae427-3157-4c21-a6b0-4340ecce26aa', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:29 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 1073741824 Nov 01 09:47:29 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa5f964-5250-44ab-8022-8d1487dd654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:29 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Volume volume-09dae427-3157-4c21-a6b0-4340ecce26aa (09dae427-3157-4c21-a6b0-4340ecce26aa): created successfully Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa5f964-5250-44ab-8022-8d1487dd654a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Flow 'volume_create_manager' (04ffdd7e-02c8-4720-bd98-902ed0adf8d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1ad78b2c-b3d1-42ab-9777-47eba48474ac tempest-CreateVolumesFromImageTest-1665163195 None] Created volume successfully. Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-09dae427-3157-4c21-a6b0-4340ecce26aa-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:29 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 1073741824" returned: 0 in 0.583s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-09dae427-3157-4c21-a6b0-4340ecce26aa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-quobyte-09dae427-3157-4c21-a6b0-4340ecce26aa" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:29 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 Nov 01 09:47:29 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-09dae427-3157-4c21-a6b0-4340ecce26aa" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec512d4a-1548-45e7-b60d-2e1992b21418]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:30 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa Nov 01 09:47:30 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:30 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8" returned: 0 in 0.327s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0a2a3a-1948-4a2c-bce2-00cb6d831fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de683a27-2cc8-4cb9-9e41-d948d73426c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Volume volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 (00cdcd62-adb7-40ab-9b09-abf453bf29c8): created successfully Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de683a27-2cc8-4cb9-9e41-d948d73426c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (f9685d45-0a14-4d45-b93e-cfc718c2f28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-353d2920-f148-4004-a4fc-d78691cac27e tempest-VolumesActionsTest-1776165658 None] Created volume successfully. Nov 01 09:47:30 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa" returned: 0 in 0.489s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:30 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa Nov 01 09:47:30 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:30 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-09dae427-3157-4c21-a6b0-4340ecce26aa" returned: 0 in 0.283s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-09dae427-3157-4c21-a6b0-4340ecce26aa" released by "delete_volume" :: held 0.868s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Created reservations ['f9e96ae0-dce9-432f-910e-8b06553ccb19', '3e5b0ace-b0ba-4c8c-9987-ebcfca51aa75', 'cca67e08-eb5b-4f2e-b052-8792d19568ef', '97a291f1-f05f-45b0-b604-50b910ec8ee1'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a232afc7-15ff-48ad-80c0-1324d1ff8d46 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8" by "attach_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a232afc7-15ff-48ad-80c0-1324d1ff8d46 tempest-VolumesActionsTest-1776165658 None] Lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8" acquired by "attach_volume" :: waited 0.041s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a232afc7-15ff-48ad-80c0-1324d1ff8d46 tempest-VolumesActionsTest-1776165658 None] Attaching volume 00cdcd62-adb7-40ab-9b09-abf453bf29c8 to instance 7428a981-0125-4615-8f3d-d0ec8624da1a at mountpoint /dev/vdb on host None. Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:31 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:31 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a232afc7-15ff-48ad-80c0-1324d1ff8d46 tempest-VolumesActionsTest-1776165658 None] Attach volume completed successfully. Nov 01 09:47:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a232afc7-15ff-48ad-80c0-1324d1ff8d46 tempest-VolumesActionsTest-1776165658 None] Lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8" released by "attach_volume" :: held 0.168s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:31 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.297s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:31 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Deleted volume successfully. Nov 01 09:47:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-88d1edbf-9f5d-45b7-874f-041cb54c2be4 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-09dae427-3157-4c21-a6b0-4340ecce26aa-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-76a86e5d-3fcb-4811-8e3d-f60c5105097f tempest-VolumesActionsTest-788117169 None] Terminate volume connection completed successfully. Nov 01 09:47:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-76a86e5d-3fcb-4811-8e3d-f60c5105097f tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-detach_volume" by "detach_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-76a86e5d-3fcb-4811-8e3d-f60c5105097f tempest-VolumesActionsTest-788117169 None] Lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-76a86e5d-3fcb-4811-8e3d-f60c5105097f tempest-VolumesActionsTest-788117169 None] Detaching volume 00cdcd62-adb7-40ab-9b09-abf453bf29c8 from instance 7428a981-0125-4615-8f3d-d0ec8624da1a. Nov 01 09:47:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-76a86e5d-3fcb-4811-8e3d-f60c5105097f tempest-VolumesActionsTest-788117169 None] Detach volume completed successfully. Nov 01 09:47:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-76a86e5d-3fcb-4811-8e3d-f60c5105097f tempest-VolumesActionsTest-788117169 None] Lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-16dc1221-be4a-40ff-b5dd-e69be10d3a06-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-16dc1221-be4a-40ff-b5dd-e69be10d3a06-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-quobyte-16dc1221-be4a-40ff-b5dd-e69be10d3a06" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-16dc1221-be4a-40ff-b5dd-e69be10d3a06" acquired by "delete_volume" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c66e6e-79a5-4cf1-8b85-d19994ad34dd]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7dfc77b9-11ee-430a-8d0f-aa6d775e59ed tempest-VolumesActionsTest-1776165658 None] Acquiring lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-detach_volume" by "detach_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7dfc77b9-11ee-430a-8d0f-aa6d775e59ed tempest-VolumesActionsTest-1776165658 None] Lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7dfc77b9-11ee-430a-8d0f-aa6d775e59ed tempest-VolumesActionsTest-1776165658 None] Volume detach called, but volume not attached. Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7dfc77b9-11ee-430a-8d0f-aa6d775e59ed tempest-VolumesActionsTest-1776165658 None] Lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:32 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 Nov 01 09:47:32 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Acquiring lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Acquiring lock "cinder-quobyte-00cdcd62-adb7-40ab-9b09-abf453bf29c8" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Lock "cinder-quobyte-00cdcd62-adb7-40ab-9b09-abf453bf29c8" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:32 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06" returned: 0 in 0.535s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f2fee-8f92-493e-9d13-967deb219cd7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:32 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06 Nov 01 09:47:32 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:32 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 Nov 01 09:47:32 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:33 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-16dc1221-be4a-40ff-b5dd-e69be10d3a06" returned: 0 in 0.340s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-16dc1221-be4a-40ff-b5dd-e69be10d3a06" released by "delete_volume" :: held 0.945s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:33 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8" returned: 0 in 0.440s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Created reservations ['4430c66e-b1d9-40b6-b673-06ee5ad6fcb6', '483821c9-4d9c-47f0-8eed-ece22227635f', 'dd104fe7-e447-46fb-8a9a-3e163eec6ffc', '84fd45b1-c081-4682-a90b-3bc2baae521c'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:33 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8 Nov 01 09:47:33 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:33 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:33 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:33 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00cdcd62-adb7-40ab-9b09-abf453bf29c8" returned: 0 in 0.395s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Lock "cinder-quobyte-00cdcd62-adb7-40ab-9b09-abf453bf29c8" released by "delete_volume" :: held 0.913s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Created reservations ['f169580c-d2f5-494b-a043-690cc9509876', '78eeea2b-3516-464e-89be-8f764906c34f', '8bb10754-4291-4048-8078-ed10c00b3e35', 'fbd3bec7-f7ff-4729-8c0b-f260f85ada7a'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:33 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.384s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Deleted volume successfully. Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8b89204d-388a-490b-8995-29a2db5f063b tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-16dc1221-be4a-40ff-b5dd-e69be10d3a06-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:33 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:33 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:34 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.410s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:34 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Deleted volume successfully. Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fde2fc39-7f33-47aa-aba0-271486d2c9ef tempest-VolumesActionsTest-1776165658 None] Lock "cinder-00cdcd62-adb7-40ab-9b09-abf453bf29c8-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Flow 'volume_create_manager' (7ab10fdf-bc91-4315-b670-92a0886f24c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd3ebaf-e8c3-469e-a3a0-371eabc3550a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fd3ebaf-e8c3-469e-a3a0-371eabc3550a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820d0f40-9378-4958-8011-18f6372c61dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3013cdf282ee46a08b308025648ba0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:34Z,use_quota=True,user_id='a3748ed15a4545c69512cbbe91b04efa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d10630-66d8-454a-a791-4b2225a964a3),volume_type_id=59d10630-66d8-454a-a791-4b2225a964a3)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba5665a-c9f8-4b3a-90ec-34293639a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba5665a-c9f8-4b3a-90ec-34293639a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8562df25-26dc-4e27-be96-a218e3021615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-quobyte-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6477b42-b37f-4140-a10b-25b47369bb80]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:34 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad Nov 01 09:47:34 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8562df25-26dc-4e27-be96-a218e3021615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '820d0f40-9378-4958-8011-18f6372c61dd', 'volume_name': 'volume-820d0f40-9378-4958-8011-18f6372c61dd', 'volume_size': 1, 'image_id': '1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0685db8a2472a327a60b647feb49444d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3013cdf282ee46a08b308025648ba0bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aaadf19af6918ac592317b429491003eff9657c20b9a865d3607575ad8c4dd4d83f197bdbd05bcc826588bfda3d67e9e65216f5f1eff6749f751f8a13537c39', 'id': '1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'created_at': datetime.datetime(2026, 11, 1, 8, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739045a3-cf0e-49cb-843c-7ffb7b507e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739045a3-cf0e-49cb-843c-7ffb7b507e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13cd7e3-6c15-4ec1-8e3b-dd3e1be0530c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:34 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Volume 820d0f40-9378-4958-8011-18f6372c61dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-820d0f40-9378-4958-8011-18f6372c61dd', 'volume_size': 1, 'image_id': '1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0685db8a2472a327a60b647feb49444d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3013cdf282ee46a08b308025648ba0bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aaadf19af6918ac592317b429491003eff9657c20b9a865d3607575ad8c4dd4d83f197bdbd05bcc826588bfda3d67e9e65216f5f1eff6749f751f8a13537c39', 'id': '1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'created_at': datetime.datetime(2026, 11, 1, 8, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 01 09:47:34 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Trying to clone 820d0f40-9378-4958-8011-18f6372c61dd from image 1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca at location (None, [{'url': 'file:///opt/stack/data/glance/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:47:35 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Image download 0.00 MB at 0.00 MB/s Nov 01 09:47:35 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad" returned: 0 in 0.399s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:35 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad Nov 01 09:47:35 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c86963-e8ab-49fd-b06c-c6b669eba3b2]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:35 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD Nov 01 09:47:35 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:35 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad" released by "delete_volume" :: held 0.759s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Created reservations ['a5f3ddcf-19c3-4c20-88f4-8627569d01a1', 'ac11d2e2-a014-4f3d-8aad-292a3fb83ce9', '0b020e06-c385-444b-8dc4-c0a2094c6d6e', '39078c1e-c10d-4fe2-b1d5-bf064e656bde'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:35 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:35 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD Nov 01 09:47:35 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:35 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:35 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:35 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Temporary image 1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca is fetched for user a3748ed15a4545c69512cbbe91b04efa. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eef8323-2599-466e-b327-c8438c8c206b]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:35 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.314s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:35 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Deleted volume successfully. Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16ba03c0-6227-4ed5-83fc-036cfa30bb69 tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-12cfe8bb-8e30-4ca9-ba1a-ee09e7bef0ad-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:36 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD Nov 01 09:47:36 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:36 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:36 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD Nov 01 09:47:36 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-d34d36da-6e84-4e3e-83e5-53119b7289b4-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:36 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820d0f40-9378-4958-8011-18f6372c61dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3013cdf282ee46a08b308025648ba0bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:34Z,use_quota=True,user_id='a3748ed15a4545c69512cbbe91b04efa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59d10630-66d8-454a-a791-4b2225a964a3),volume_type_id=59d10630-66d8-454a-a791-4b2225a964a3)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Creating volume 820d0f40-9378-4958-8011-18f6372c61dd {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:36 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-d34d36da-6e84-4e3e-83e5-53119b7289b4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:36 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd 1073741824 Nov 01 09:47:36 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-quobyte-d34d36da-6e84-4e3e-83e5-53119b7289b4" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-d34d36da-6e84-4e3e-83e5-53119b7289b4" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94f5dd3-235c-4938-b16a-fc185b002044]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:36 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 Nov 01 09:47:36 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:37 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd 1073741824" returned: 0 in 0.546s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:37 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4" returned: 0 in 0.458s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:37 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4 Nov 01 09:47:37 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:37 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd Nov 01 09:47:37 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (6345e81c-6518-4920-a219-7bb5842fe2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde96f4a-a4c0-4c7e-a857-c78d1fe8a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde96f4a-a4c0-4c7e-a857-c78d1fe8a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2139759125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74157ae2-16ae-47a9-8e28-63f9efe6973e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:37Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf18c76-0242-4985-a365-4212c6c9d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bf18c76-0242-4985-a365-4212c6c9d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb3095b-21d8-48a8-8699-50bd8671aa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb3095b-21d8-48a8-8699-50bd8671aa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74157ae2-16ae-47a9-8e28-63f9efe6973e', 'volume_name': 'volume-74157ae2-16ae-47a9-8e28-63f9efe6973e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaa06b6-05e4-4a7a-bbde-1cd249270717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aaa06b6-05e4-4a7a-bbde-1cd249270717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4445402-32c2-4d8d-b7c9-9ada8b9a6b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:37 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Volume 74157ae2-16ae-47a9-8e28-63f9efe6973e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74157ae2-16ae-47a9-8e28-63f9efe6973e', 'volume_size': 1} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:37 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d34d36da-6e84-4e3e-83e5-53119b7289b4" returned: 0 in 0.278s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:37 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-d34d36da-6e84-4e3e-83e5-53119b7289b4" released by "delete_volume" :: held 0.792s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.150s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2139759125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74157ae2-16ae-47a9-8e28-63f9efe6973e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:37Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Creating volume 74157ae2-16ae-47a9-8e28-63f9efe6973e {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:37 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:37 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e 1073741824 Nov 01 09:47:37 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Attempting download of 1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca ((None, [{'url': 'file:///opt/stack/data/glance/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'metadata': {}}])) to volume 820d0f40-9378-4958-8011-18f6372c61dd. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Created reservations ['86b37798-14b6-46d0-a46d-da83b5b63699', '58653fa5-cd61-4982-b752-4bdd543ded6f', '2db0ee87-c4c1-44f8-9b59-4be0caa33faa', '9ae20e4d-a0e1-43af-8ce8-6f810cb5c659'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b9871b-df2a-4205-993e-b88d4decd86d]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_v9k981dk {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:37 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:37 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:37 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_v9k981dk Nov 01 09:47:37 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-5dc86f37-4ffc-44f5-9816-efea7dda9bb7-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-5dc86f37-4ffc-44f5-9816-efea7dda9bb7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "cinder-quobyte-5dc86f37-4ffc-44f5-9816-efea7dda9bb7" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-5dc86f37-4ffc-44f5-9816-efea7dda9bb7" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4898b9d-a2c6-4939-a475-8b9f9444df03]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:38 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_v9k981dk" returned: 0 in 0.371s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_v9k981dk {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:38 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e 1073741824" returned: 0 in 0.534s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:38 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:38 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:38 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Deleted volume successfully. Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6169caf1-7d71-4eaf-9926-629b41b0d9ed tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-d34d36da-6e84-4e3e-83e5-53119b7289b4-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:38 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_v9k981dk Nov 01 09:47:38 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:38 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e Nov 01 09:47:38 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:38 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7" returned: 0 in 0.413s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:38 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7 Nov 01 09:47:38 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:38 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_v9k981dk" returned: 1 in 0.369s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_v9k981dk' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd6872e-64c0-4d56-aa10-2db7ce7db9e6]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:38 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e" returned: 0 in 0.290s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4445402-32c2-4d8d-b7c9-9ada8b9a6b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74157ae2-16ae-47a9-8e28-63f9efe6973e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966991f6-3c12-467c-9ffd-9e86a563a10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:38 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Volume volume-74157ae2-16ae-47a9-8e28-63f9efe6973e (74157ae2-16ae-47a9-8e28-63f9efe6973e): created successfully Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966991f6-3c12-467c-9ffd-9e86a563a10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (6345e81c-6518-4920-a219-7bb5842fe2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fa215a5f-06a1-43c0-9518-aae4be08b943 tempest-VolumesActionsTest-1776165658 None] Created volume successfully. Nov 01 09:47:38 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD Nov 01 09:47:38 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:38 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc86f37-4ffc-44f5-9816-efea7dda9bb7" returned: 0 in 0.277s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-quobyte-5dc86f37-4ffc-44f5-9816-efea7dda9bb7" released by "delete_volume" :: held 0.737s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Created reservations ['3c8258a9-af35-4f6a-bd44-cb809666b9ae', 'fdba7ab8-9213-4122-bf90-b7c16de282aa', 'f618bc84-c751-4491-9640-c8f28a383d17', '161c6dad-bd74-4daa-bb7d-d033260f8aa5'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:38 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:38 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:38 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:38 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD Nov 01 09:47:38 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:39 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.247s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Deleted volume successfully. Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-61e9505d-05cc-42a6-a43e-c7642267b0cb tempest-CreateVolumesFromImageTest-1665163195 None] Lock "cinder-5dc86f37-4ffc-44f5-9816-efea7dda9bb7-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:39 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] 1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca was raw, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:39 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd Nov 01 09:47:39 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-74157ae2-16ae-47a9-8e28-63f9efe6973e-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Lock "cinder-74157ae2-16ae-47a9-8e28-63f9efe6973e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-quobyte-74157ae2-16ae-47a9-8e28-63f9efe6973e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Lock "cinder-quobyte-74157ae2-16ae-47a9-8e28-63f9efe6973e" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d62e52a-b8bf-4415-adac-83b0c5e8dd03]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:39 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd" returned: 0 in 0.620s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca_tgf87xeidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:47:39 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 09:47:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:39 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd 1G Nov 01 09:47:39 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:39 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e Nov 01 09:47:39 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:40 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd 1G" returned: 0 in 0.343s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Downloaded image 1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca ((None, [{'url': 'file:///opt/stack/data/glance/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'metadata': {}}])) to volume 820d0f40-9378-4958-8011-18f6372c61dd successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Temporary image 1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca for user a3748ed15a4545c69512cbbe91b04efa is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Marking volume 820d0f40-9378-4958-8011-18f6372c61dd as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Copying metadata from image 1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca to 820d0f40-9378-4958-8011-18f6372c61dd. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Creating volume glance metadata for volume 820d0f40-9378-4958-8011-18f6372c61dd backed by image 1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0685db8a2472a327a60b647feb49444d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:47:40 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e" returned: 0 in 0.425s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:40 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e Nov 01 09:47:40 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13cd7e3-6c15-4ec1-8e3b-dd3e1be0530c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820d0f40-9378-4958-8011-18f6372c61dd', 'volume_size': 1, 'image_id': '1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0685db8a2472a327a60b647feb49444d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3013cdf282ee46a08b308025648ba0bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8aaadf19af6918ac592317b429491003eff9657c20b9a865d3607575ad8c4dd4d83f197bdbd05bcc826588bfda3d67e9e65216f5f1eff6749f751f8a13537c39', 'id': '1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca', 'created_at': datetime.datetime(2026, 11, 1, 8, 47, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1bd7c7ff-8f1d-4411-ac13-fa9b13e661ca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870bf559-515b-45f6-8536-e2e890db80a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:40 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Volume volume-820d0f40-9378-4958-8011-18f6372c61dd (820d0f40-9378-4958-8011-18f6372c61dd): created successfully Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (870bf559-515b-45f6-8536-e2e890db80a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Flow 'volume_create_manager' (7ab10fdf-bc91-4315-b670-92a0886f24c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:40 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-271826d0-1e49-4c03-8746-ef1fe0010d11 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Created volume successfully. Nov 01 09:47:40 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-74157ae2-16ae-47a9-8e28-63f9efe6973e" returned: 0 in 0.302s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Lock "cinder-quobyte-74157ae2-16ae-47a9-8e28-63f9efe6973e" released by "delete_volume" :: held 0.783s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Created reservations ['ccfda967-93c8-47ae-b58b-54dfdc805298', '6dc3356c-fa6e-4422-8e60-439b65d23daa', '715e3f9e-cfa5-4710-876b-96d2c4dd9468', '7bd261c5-c28c-41dc-9efd-ddd42f44f29e'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:40 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:40 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Acquiring lock "cinder-820d0f40-9378-4958-8011-18f6372c61dd-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "cinder-820d0f40-9378-4958-8011-18f6372c61dd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Acquiring lock "cinder-quobyte-820d0f40-9378-4958-8011-18f6372c61dd" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "cinder-quobyte-820d0f40-9378-4958-8011-18f6372c61dd" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ba6336-4d9b-4b53-9c1e-0c38699fae8c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:41 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.376s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Deleted volume successfully. Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fb1aa6bb-fcbd-467b-a4e2-84b59f6f9732 tempest-VolumesActionsTest-788117169 None] Lock "cinder-74157ae2-16ae-47a9-8e28-63f9efe6973e-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:41 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd Nov 01 09:47:41 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:41 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd" returned: 0 in 0.442s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:41 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd Nov 01 09:47:41 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (82693b40-d8f1-473b-9334-1ff5af24b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcdf5b59-c09d-45f2-ba8b-5c484fa31ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcdf5b59-c09d-45f2-ba8b-5c484fa31ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-8691639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcd7a3d-71ce-4307-83db-1136df933bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:41Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e180705-97ec-4c38-b509-7f3d1a6821e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e180705-97ec-4c38-b509-7f3d1a6821e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40588c6b-f522-485f-9426-d15a094064f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40588c6b-f522-485f-9426-d15a094064f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbcd7a3d-71ce-4307-83db-1136df933bcf', 'volume_name': 'volume-dbcd7a3d-71ce-4307-83db-1136df933bcf', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8cb30f-f5e2-49c2-88e8-f59ff10681aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8cb30f-f5e2-49c2-88e8-f59ff10681aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc251af3-ca71-4a80-91d9-eba99e6482a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:41 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Volume dbcd7a3d-71ce-4307-83db-1136df933bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbcd7a3d-71ce-4307-83db-1136df933bcf', 'volume_size': 1} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-8691639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbcd7a3d-71ce-4307-83db-1136df933bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:41Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Creating volume dbcd7a3d-71ce-4307-83db-1136df933bcf {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:41 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:41 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf 1073741824 Nov 01 09:47:41 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:41 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-820d0f40-9378-4958-8011-18f6372c61dd" returned: 0 in 0.291s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "cinder-quobyte-820d0f40-9378-4958-8011-18f6372c61dd" released by "delete_volume" :: held 0.788s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:41 devstack cinder-volume[86594]: WARNING cinder.quota [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:47:41 devstack cinder-volume[86594]: WARNING cinder.quota [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Created reservations ['99c8e0d1-c5fa-42cb-b2db-938c02c38109', '5129f981-ad5a-4617-99df-9d44bdc95e65', '5a8f0d76-242a-46bd-8a73-5422e14a2466', '22176514-b901-45b7-bf89-edaa479cceca'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:41 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:41 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:42 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf 1073741824" returned: 0 in 0.510s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:42 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf Nov 01 09:47:42 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.306s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:42 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Deleted volume successfully. Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4fc9eb3b-f304-4b7f-a842-f7ea3903fb63 tempest-VolumeAndVolumeTypeFromImageTest-103423253 None] Lock "cinder-820d0f40-9378-4958-8011-18f6372c61dd-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:42 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf" returned: 0 in 0.344s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc251af3-ca71-4a80-91d9-eba99e6482a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbcd7a3d-71ce-4307-83db-1136df933bcf', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3155bb64-2399-40ec-bad7-d6c7267c8771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:42 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Volume volume-dbcd7a3d-71ce-4307-83db-1136df933bcf (dbcd7a3d-71ce-4307-83db-1136df933bcf): created successfully Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3155bb64-2399-40ec-bad7-d6c7267c8771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (82693b40-d8f1-473b-9334-1ff5af24b10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-dadb5cf4-a8f5-4f0b-8515-70b228b21e67 tempest-VolumesActionsTest-1776165658 None] Created volume successfully. Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Flow 'volume_create_manager' (dbcd67d1-ac4b-4043-8595-b3ec60ce5929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b0d92-e726-4f37-8ebd-52ba17db89a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b0d92-e726-4f37-8ebd-52ba17db89a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-191581156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26845d1-7535-46a0-8c69-ea6ce0b82cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421a30ccaf5246c9a680d205da989443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:43Z,use_quota=True,user_id='98118cea2ee544609d4e248e59e72f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fccba1-7287-400f-9a56-85f6c5a382f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fccba1-7287-400f-9a56-85f6c5a382f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bc6593-a200-4a60-b41b-6f175838b056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73bc6593-a200-4a60-b41b-6f175838b056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26845d1-7535-46a0-8c69-ea6ce0b82cd6', 'volume_name': 'volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e1ef9d-44c9-4f47-a7ab-1c0511c9c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e1ef9d-44c9-4f47-a7ab-1c0511c9c819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a9aac6-3688-488b-8173-8ae59502cccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:42 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Volume b26845d1-7535-46a0-8c69-ea6ce0b82cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6', 'volume_size': 1} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-191581156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26845d1-7535-46a0-8c69-ea6ce0b82cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421a30ccaf5246c9a680d205da989443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:43Z,use_quota=True,user_id='98118cea2ee544609d4e248e59e72f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Creating volume b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:42 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:42 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 1073741824 Nov 01 09:47:42 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:43 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 1073741824" returned: 0 in 0.461s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:43 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 Nov 01 09:47:43 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:43 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" returned: 0 in 0.292s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a9aac6-3688-488b-8173-8ae59502cccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafcd7e7-0b6a-4085-9119-75c03a10fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:43 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Volume volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 (b26845d1-7535-46a0-8c69-ea6ce0b82cd6): created successfully Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafcd7e7-0b6a-4085-9119-75c03a10fb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Flow 'volume_create_manager' (dbcd67d1-ac4b-4043-8595-b3ec60ce5929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:43 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f574a98b-045a-4bf5-8402-580329587e48 tempest-VolumeDependencyTests-1930607159 None] Created volume successfully. Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-dbcd7a3d-71ce-4307-83db-1136df933bcf-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Lock "cinder-dbcd7a3d-71ce-4307-83db-1136df933bcf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-quobyte-dbcd7a3d-71ce-4307-83db-1136df933bcf" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Lock "cinder-quobyte-dbcd7a3d-71ce-4307-83db-1136df933bcf" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afa5be8-3a1f-425b-8cbd-9d0b40f646a6]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:43 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf Nov 01 09:47:43 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:44 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf" returned: 0 in 0.390s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:44 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf Nov 01 09:47:44 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:44 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dbcd7a3d-71ce-4307-83db-1136df933bcf" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Lock "cinder-quobyte-dbcd7a3d-71ce-4307-83db-1136df933bcf" released by "delete_volume" :: held 0.729s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Created reservations ['1acaef43-1311-4e31-a2aa-55c67934c5cc', '20ac28df-86f3-453f-8d9b-6c90aecca3bc', 'edf3b146-afd3-447a-8dac-8cdcd87d980b', '73c5c96a-036c-4f3a-b6a7-39b01f4eab68'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:44 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:44 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Creating offline snapshot 41d1dfe4-0755-4d60-ad18-3ac41aea3320 of volume b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c564a-519c-43fb-8cc7-e2ba7bf503e4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:45 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.333s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Deleted volume successfully. Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b4f3f2e-571d-42c9-9b12-9d9ccca21200 tempest-VolumesActionsTest-788117169 None] Lock "cinder-dbcd7a3d-71ce-4307-83db-1136df933bcf-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:45 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 Nov 01 09:47:45 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:45 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" returned: 0 in 0.435s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:45 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 1G Nov 01 09:47:45 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (6b5a02f2-1bdc-4bca-88dd-7cec0a187fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f2cf9a-c512-467c-8175-a100ea91e999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f2cf9a-c512-467c-8175-a100ea91e999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-412293258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95aacd32-5806-4ae6-8c9a-45f2816b29ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:45Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d177d88-197e-4741-8941-3bc861d37f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d177d88-197e-4741-8941-3bc861d37f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1f6ff5-4aa4-4e09-8de1-773b67b1706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1f6ff5-4aa4-4e09-8de1-773b67b1706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95aacd32-5806-4ae6-8c9a-45f2816b29ae', 'volume_name': 'volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc4f45b-714e-4eae-a755-590671ed7147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc4f45b-714e-4eae-a755-590671ed7147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549286b9-11f5-4ae9-ae55-3970807ef2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:45 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Volume 95aacd32-5806-4ae6-8c9a-45f2816b29ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae', 'volume_size': 1} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:45 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 1G" returned: 0 in 0.485s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:45 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 Nov 01 09:47:45 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:46 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320" returned: 0 in 0.300s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:46 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 is being set with open permissions: ugo+rw Nov 01 09:47:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:46 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 Nov 01 09:47:46 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:46 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320" returned: 0 in 0.247s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:46 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.info Nov 01 09:47:46 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:46 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.info" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:46 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.info is being set with open permissions: ugo+rw Nov 01 09:47:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:46 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.info Nov 01 09:47:46 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:46 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.info" returned: 0 in 0.249s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.083s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-412293258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95aacd32-5806-4ae6-8c9a-45f2816b29ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:45Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Creating volume 95aacd32-5806-4ae6-8c9a-45f2816b29ae {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:47 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:47 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae 1073741824 Nov 01 09:47:47 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:47 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b5c0465b-4e8c-4247-81e6-2c0cfc45882f tempest-VolumeDependencyTests-1930607159 None] Create snapshot completed successfully Nov 01 09:47:47 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae 1073741824" returned: 0 in 0.460s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:47 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae Nov 01 09:47:47 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:47 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae" returned: 0 in 0.271s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549286b9-11f5-4ae9-ae55-3970807ef2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef78e783-6b22-4666-9be8-7a39002b8c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:47 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Volume volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae (95aacd32-5806-4ae6-8c9a-45f2816b29ae): created successfully Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef78e783-6b22-4666-9be8-7a39002b8c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (6b5a02f2-1bdc-4bca-88dd-7cec0a187fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:47 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-55b35f30-7b82-4c3d-a66d-6c07df24cfd1 tempest-VolumesActionsTest-1776165658 None] Created volume successfully. Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Flow 'volume_create_manager' (52b2009d-8be2-462f-a72f-7c8d3f226f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd59a996-f5a9-4d5f-8f82-d49da350ad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd59a996-f5a9-4d5f-8f82-d49da350ad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-695256450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b119cfb2-58bd-4f0d-a4a0-4914cd578bac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='421a30ccaf5246c9a680d205da989443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41d1dfe4-0755-4d60-ad18-3ac41aea3320,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:49Z,use_quota=True,user_id='98118cea2ee544609d4e248e59e72f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7b0cf6-8ee8-4666-b8ed-ec5d71358131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7b0cf6-8ee8-4666-b8ed-ec5d71358131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4522fdfe-53cc-47b6-af53-9183236201c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4522fdfe-53cc-47b6-af53-9183236201c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b119cfb2-58bd-4f0d-a4a0-4914cd578bac', 'volume_name': 'volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac', 'volume_size': 1, 'snapshot_id': '41d1dfe4-0755-4d60-ad18-3ac41aea3320'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492de9a4-649b-4b4f-a984-034770114d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492de9a4-649b-4b4f-a984-034770114d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba77541b-fe8c-4100-a8a3-05eee0c195a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:48 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Volume b119cfb2-58bd-4f0d-a4a0-4914cd578bac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac', 'volume_size': 1, 'snapshot_id': '41d1dfe4-0755-4d60-ad18-3ac41aea3320'} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-quobyte-41d1dfe4-0755-4d60-ad18-3ac41aea3320-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-41d1dfe4-0755-4d60-ad18-3ac41aea3320-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Creating volume b119cfb2-58bd-4f0d-a4a0-4914cd578bac from snapshot 41d1dfe4-0755-4d60-ad18-3ac41aea3320 {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-quobyte-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] snapshot: 41d1dfe4-0755-4d60-ad18-3ac41aea3320, volume: b119cfb2-58bd-4f0d-a4a0-4914cd578bac, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fc28ae-623a-42aa-80a6-07df435c757e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-95aacd32-5806-4ae6-8c9a-45f2816b29ae-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Lock "cinder-95aacd32-5806-4ae6-8c9a-45f2816b29ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-quobyte-95aacd32-5806-4ae6-8c9a-45f2816b29ae" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Lock "cinder-quobyte-95aacd32-5806-4ae6-8c9a-45f2816b29ae" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:48 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 Nov 01 09:47:48 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[06df82b3-f3c7-465e-ae2d-eacd96a99a1a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:49 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae Nov 01 09:47:49 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:49 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320" returned: 0 in 0.398s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[248e52e7-c058-4752-a110-b855269c05a2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:49 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 Nov 01 09:47:49 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:49 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae" returned: 0 in 0.442s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:49 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae Nov 01 09:47:49 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:49 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" returned: 0 in 0.477s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:49 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95aacd32-5806-4ae6-8c9a-45f2816b29ae" returned: 0 in 0.314s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Lock "cinder-quobyte-95aacd32-5806-4ae6-8c9a-45f2816b29ae" released by "delete_volume" :: held 0.822s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:49 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac Nov 01 09:47:49 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Created reservations ['8cc37ec4-3a21-47e2-8e33-72dbd46506d2', '38f7292a-976e-4bbd-a4fa-0fa0aed2a449', 'bd0ba7df-3be5-49de-a5b6-3bdfad56c0da', 'f420f810-8ae8-44bf-a3a2-1387345b129d'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:49 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:49 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:50 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.316s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:50 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Deleted volume successfully. Nov 01 09:47:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-92badb99-a71e-4851-bb8b-17516e6562a2 tempest-VolumesActionsTest-788117169 None] Lock "cinder-95aacd32-5806-4ae6-8c9a-45f2816b29ae-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (f5958ad3-9105-4b95-b52e-3502e17a8eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4466157-b1fc-4b1b-899b-377f4827dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4466157-b1fc-4b1b-899b-377f4827dfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-382730415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152b9c7a-b0db-4b05-a331-41ffb28036c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:51Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31183c7d-2ec9-4f94-bcea-45b17fbae644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31183c7d-2ec9-4f94-bcea-45b17fbae644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a8c57f-125f-48c4-b412-1ed324063702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a8c57f-125f-48c4-b412-1ed324063702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152b9c7a-b0db-4b05-a331-41ffb28036c9', 'volume_name': 'volume-152b9c7a-b0db-4b05-a331-41ffb28036c9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd9dec8-c9ca-44f9-bb63-49738aa16c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd9dec8-c9ca-44f9-bb63-49738aa16c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4615b8-1b43-41d9-8311-813fbf624c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:51 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Volume 152b9c7a-b0db-4b05-a331-41ffb28036c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152b9c7a-b0db-4b05-a331-41ffb28036c9', 'volume_size': 1} Nov 01 09:47:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:53 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:47:53 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:53 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.334s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:47:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:47:57 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" returned: 0 in 7.741s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:47:57 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Converted 1024.00 MB image at 132.25 MB/s Nov 01 09:47:57 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac is being set with open permissions: ugo+rw Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:57 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac Nov 01 09:47:57 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:57 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" released by "_copy_volume_from_snapshot" :: held 8.998s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-41d1dfe4-0755-4d60-ad18-3ac41aea3320-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" released by "_create_volume_from_snapshot" :: held 9.073s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.094s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.564s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-382730415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152b9c7a-b0db-4b05-a331-41ffb28036c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:47:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:47:51Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Creating volume 152b9c7a-b0db-4b05-a331-41ffb28036c9 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:47:57 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:57 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 1073741824 Nov 01 09:47:57 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba77541b-fe8c-4100-a8a3-05eee0c195a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac', 'volume_size': 1, 'snapshot_id': '41d1dfe4-0755-4d60-ad18-3ac41aea3320'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8a16a8-e994-4bb6-82ad-364ac6bd9d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:57 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Volume volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac (b119cfb2-58bd-4f0d-a4a0-4914cd578bac): created successfully Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8a16a8-e994-4bb6-82ad-364ac6bd9d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Flow 'volume_create_manager' (52b2009d-8be2-462f-a72f-7c8d3f226f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:57 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5a91121d-ba48-4763-b8fa-c8a7c4a7ec14 tempest-VolumeDependencyTests-1930607159 None] Created volume successfully. Nov 01 09:47:58 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 1073741824" returned: 0 in 0.430s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:58 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 Nov 01 09:47:58 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-41d1dfe4-0755-4d60-ad18-3ac41aea3320-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-41d1dfe4-0755-4d60-ad18-3ac41aea3320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-quobyte-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-quobyte-41d1dfe4-0755-4d60-ad18-3ac41aea3320" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:58 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9" returned: 0 in 0.409s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-41d1dfe4-0755-4d60-ad18-3ac41aea3320" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Deleting offline snapshot 41d1dfe4-0755-4d60-ad18-3ac41aea3320 of volume b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] snapshot_file for this snap is: volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4615b8-1b43-41d9-8311-813fbf624c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152b9c7a-b0db-4b05-a331-41ffb28036c9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a978ef4-0dc4-4007-abad-7b1bf2868738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[37659a9f-d9e2-47a0-a92e-25e1949793b6]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:58 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Volume volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 (152b9c7a-b0db-4b05-a331-41ffb28036c9): created successfully Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a978ef4-0dc4-4007-abad-7b1bf2868738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:47:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (f5958ad3-9105-4b95-b52e-3502e17a8eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:47:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1a837197-e96f-4e23-b0e4-22113a3c05d9 tempest-VolumesActionsTest-1776165658 None] Created volume successfully. Nov 01 09:47:58 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 Nov 01 09:47:58 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:59 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320" returned: 0 in 0.406s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:47:59 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bdb6ca-5edc-48d9-be61-c07f44ecede9]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:47:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:59 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 Nov 01 09:47:59 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:59 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Nov 01 09:47:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" returned: 0 in 0.564s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:47:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:47:59 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 Nov 01 09:47:59 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:47:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-152b9c7a-b0db-4b05-a331-41ffb28036c9-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:47:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Lock "cinder-152b9c7a-b0db-4b05-a331-41ffb28036c9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Acquiring lock "cinder-quobyte-152b9c7a-b0db-4b05-a331-41ffb28036c9" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Lock "cinder-quobyte-152b9c7a-b0db-4b05-a331-41ffb28036c9" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef45f8d9-f686-4eb6-b792-860f78de0efe]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:00 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320" returned: 0 in 0.409s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:00 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 Nov 01 09:48:00 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:00 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320 Nov 01 09:48:00 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:00 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6.41d1dfe4-0755-4d60-ad18-3ac41aea3320" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:00 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-41d1dfe4-0755-4d60-ad18-3ac41aea3320" released by "_delete_snapshot" :: held 1.810s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9" returned: 0 in 0.444s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" released by "delete_snapshot" :: held 1.862s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:00 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9 Nov 01 09:48:00 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Created reservations ['15c8ae39-dc0c-4eb6-96d4-f0b4a91fbc73', '76813924-4910-4ccf-baa4-b27d11767919', '544828a4-9eca-45b4-ab8d-8ca5d2e74f0c', '73452a41-d232-4d15-aea4-2a8e1032e6c3'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:00 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Delete snapshot completed successfully. Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5229bfd1-97d3-449f-8f6a-bba5a1dd03e5 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-41d1dfe4-0755-4d60-ad18-3ac41aea3320-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-b26845d1-7535-46a0-8c69-ea6ce0b82cd6-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-b26845d1-7535-46a0-8c69-ea6ce0b82cd6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-quobyte-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:00 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-152b9c7a-b0db-4b05-a331-41ffb28036c9" returned: 0 in 0.378s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Lock "cinder-quobyte-152b9c7a-b0db-4b05-a331-41ffb28036c9" released by "delete_volume" :: held 0.871s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" acquired by "delete_volume" :: waited 0.041s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e435e70b-2327-4de7-9c2e-a1e912a650be]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Created reservations ['bfd77774-73b5-447d-baf7-c0390249fc59', '32540601-4b01-47f1-b113-271f97b4513f', '843f75d3-644d-423c-a86f-9306400c66b1', '3ad22c7c-502e-44ec-b552-48ba165eba2c'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:01 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 Nov 01 09:48:01 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:01 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:01 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:01 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" returned: 0 in 0.543s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:01 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:01 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6 Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.420s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:01 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:01 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Deleted volume successfully. Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6e70682e-9aea-49a9-90e2-f65e38b14ac6 tempest-VolumesActionsTest-788117169 None] Lock "cinder-152b9c7a-b0db-4b05-a331-41ffb28036c9-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:01 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" returned: 0 in 0.307s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-b26845d1-7535-46a0-8c69-ea6ce0b82cd6" released by "delete_volume" :: held 0.937s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (38560a2a-43b8-4581-8df1-3bbaddb2de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8d036a-2105-4e42-b612-2ec55bdaa39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8d036a-2105-4e42-b612-2ec55bdaa39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1991067139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8e716d-3d05-4adc-bb7a-7d238e2092f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:02Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4923bf-33b7-479c-8161-141a26cbaa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4923bf-33b7-479c-8161-141a26cbaa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1185a1b0-7b56-4aa5-9302-438425355845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1185a1b0-7b56-4aa5-9302-438425355845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f8e716d-3d05-4adc-bb7a-7d238e2092f7', 'volume_name': 'volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ecb845-78a4-478b-a9ca-307b14d21963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35ecb845-78a4-478b-a9ca-307b14d21963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54955077-afc6-4c47-947f-894b303ab709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:01 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Volume 9f8e716d-3d05-4adc-bb7a-7d238e2092f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7', 'volume_size': 1} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1991067139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f8e716d-3d05-4adc-bb7a-7d238e2092f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='513908f9db0d4f9e8c91df7fdf061ae8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:02Z,use_quota=True,user_id='94bff83cc7db491f89ea2c1335da6263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Creating volume 9f8e716d-3d05-4adc-bb7a-7d238e2092f7 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:01 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Created reservations ['eaad19c8-e59b-4ef7-b7ab-aa830f55ffd3', '2025b4f1-3338-4b33-a5bf-ca3e3879ef16', '550575e0-4ac3-40a8-96b0-a07c4b02688c', '22391024-f9f3-48e1-8725-d4bbac8d53cc'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:02 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 1073741824 Nov 01 09:48:02 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:02 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:02 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:02 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.308s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:02 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Deleted volume successfully. Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d809b0f-c932-4ebf-860b-cec7705822d3 tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-b26845d1-7535-46a0-8c69-ea6ce0b82cd6-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:02 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 1073741824" returned: 0 in 0.546s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:02 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 Nov 01 09:48:02 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:02 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7" returned: 0 in 0.260s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54955077-afc6-4c47-947f-894b303ab709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e7e55b-e7ac-475d-9c3a-426329c744ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:02 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Volume volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 (9f8e716d-3d05-4adc-bb7a-7d238e2092f7): created successfully Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e7e55b-e7ac-475d-9c3a-426329c744ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Flow 'volume_create_manager' (38560a2a-43b8-4581-8df1-3bbaddb2de90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:02 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6f455a93-0cb1-4c19-b551-41998752fca3 tempest-VolumesActionsTest-1776165658 None] Created volume successfully. Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-b119cfb2-58bd-4f0d-a4a0-4914cd578bac-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-b119cfb2-58bd-4f0d-a4a0-4914cd578bac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "cinder-quobyte-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf796fd-1341-4e8a-a31f-5aa928d9ff69]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:03 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac Nov 01 09:48:03 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:03 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" returned: 0 in 0.398s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:03 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac Nov 01 09:48:03 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:03 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-quobyte-b119cfb2-58bd-4f0d-a4a0-4914cd578bac" released by "delete_volume" :: held 0.721s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:03 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Created reservations ['6c2a253a-1bd0-4579-97ed-935de242d4e7', '15d1906c-6f30-42a3-8c1b-7fb56817580f', '06ebbd3e-ceb0-4ab5-ac67-8c15f24a0369', '9bcf0f25-0c20-4c40-bd82-abb7b8406b66'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:04 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:04 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:04 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.323s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:04 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Deleted volume successfully. Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0d8c52b0-b143-4a12-bed1-b1e32a2d801c tempest-VolumeDependencyTests-1930607159 None] Lock "cinder-b119cfb2-58bd-4f0d-a4a0-4914cd578bac-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "cinder-9f8e716d-3d05-4adc-bb7a-7d238e2092f7-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Lock "cinder-9f8e716d-3d05-4adc-bb7a-7d238e2092f7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "cinder-quobyte-9f8e716d-3d05-4adc-bb7a-7d238e2092f7" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Lock "cinder-quobyte-9f8e716d-3d05-4adc-bb7a-7d238e2092f7" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f89be6-db1d-4a98-b47b-55ea89d2e1ca]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:04 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 Nov 01 09:48:04 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:05 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7" returned: 0 in 0.449s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:05 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7 Nov 01 09:48:05 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:05 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f8e716d-3d05-4adc-bb7a-7d238e2092f7" returned: 0 in 0.343s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Lock "cinder-quobyte-9f8e716d-3d05-4adc-bb7a-7d238e2092f7" released by "delete_volume" :: held 0.845s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Created reservations ['9b3c3f87-5b26-4284-ba78-56a8f36f3456', 'b8699840-da5a-43d1-9610-8538d8c15ccc', '1b402ec0-bc23-4c63-938c-c0e061ba86e8', '32c55403-8ff9-4d7e-b625-89ee3376937f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:05 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:05 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:06 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.323s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:06 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Deleted volume successfully. Nov 01 09:48:06 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3f37e46b-17c7-4ca8-8f22-edfcf6a07098 tempest-VolumesActionsTest-1776165658 None] Lock "cinder-9f8e716d-3d05-4adc-bb7a-7d238e2092f7-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Flow 'volume_create_manager' (a832c375-aa1c-439d-8a80-96017df6eb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f171de-8839-4098-9b71-d4174b4de795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f171de-8839-4098-9b71-d4174b4de795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201605697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ca9da8-984c-40b1-9222-ff4784455192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e77bf89ad42a09159a4515b190424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:09Z,use_quota=True,user_id='4593a61c5fc743fcbad73b9262bf1b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9378febe-ea9c-4b88-81b4-f3f55e984466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9378febe-ea9c-4b88-81b4-f3f55e984466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48547bb5-b37b-4346-a650-a3145eea2d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48547bb5-b37b-4346-a650-a3145eea2d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ca9da8-984c-40b1-9222-ff4784455192', 'volume_name': 'volume-95ca9da8-984c-40b1-9222-ff4784455192', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b80c7b-c622-497d-b9af-590f2c224d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b80c7b-c622-497d-b9af-590f2c224d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8bdba8-8dd4-4167-a6a2-4d0138385c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:08 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Volume 95ca9da8-984c-40b1-9222-ff4784455192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ca9da8-984c-40b1-9222-ff4784455192', 'volume_size': 1} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1201605697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ca9da8-984c-40b1-9222-ff4784455192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e77bf89ad42a09159a4515b190424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:09Z,use_quota=True,user_id='4593a61c5fc743fcbad73b9262bf1b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Creating volume 95ca9da8-984c-40b1-9222-ff4784455192 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:08 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:08 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 1073741824 Nov 01 09:48:08 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:09 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 1073741824" returned: 0 in 0.473s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:09 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 Nov 01 09:48:09 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:09 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192" returned: 0 in 0.302s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d8bdba8-8dd4-4167-a6a2-4d0138385c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ca9da8-984c-40b1-9222-ff4784455192', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0c6788-7b93-4f38-a8cb-ae6e809853e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Volume volume-95ca9da8-984c-40b1-9222-ff4784455192 (95ca9da8-984c-40b1-9222-ff4784455192): created successfully Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0c6788-7b93-4f38-a8cb-ae6e809853e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Flow 'volume_create_manager' (a832c375-aa1c-439d-8a80-96017df6eb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e94c216b-69fc-46f6-9e06-58402e66e19e tempest-ProjectReaderTests-787090626 None] Created volume successfully. Nov 01 09:48:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Acquiring lock "cinder-95ca9da8-984c-40b1-9222-ff4784455192-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Lock "cinder-95ca9da8-984c-40b1-9222-ff4784455192-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Acquiring lock "cinder-quobyte-95ca9da8-984c-40b1-9222-ff4784455192" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Lock "cinder-quobyte-95ca9da8-984c-40b1-9222-ff4784455192" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:11 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff04933-307f-4bbd-a262-be8bafefd48d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:11 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 Nov 01 09:48:11 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:11 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192" returned: 0 in 0.467s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:11 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192 Nov 01 09:48:11 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:12 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-95ca9da8-984c-40b1-9222-ff4784455192" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Lock "cinder-quobyte-95ca9da8-984c-40b1-9222-ff4784455192" released by "delete_volume" :: held 0.849s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Created reservations ['48e9d2bf-d8c9-4faf-a4eb-6a7c8eeb52a8', 'c58cdad2-1ec0-42c1-a51a-ff863a986508', 'e5c6a02a-8aa0-4ec6-bbb3-7d128672b334', '4f7222d9-9109-4a78-ad67-920f4ccd7234'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:12 devstack sudo[102864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:12 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:12 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.339s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:12 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Deleted volume successfully. Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8231d876-3e6c-4af4-9be4-8d0bd5980240 tempest-ProjectReaderTests-787090626 None] Lock "cinder-95ca9da8-984c-40b1-9222-ff4784455192-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Flow 'volume_create_manager' (40ce883e-11cf-4494-ac1c-0c5fda3d76d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14b0063-034d-4abb-bd92-066887c6672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14b0063-034d-4abb-bd92-066887c6672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123102876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fd8d16-1b67-47b7-89dc-ffa08c7c0d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e77bf89ad42a09159a4515b190424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:13Z,use_quota=True,user_id='4593a61c5fc743fcbad73b9262bf1b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96a6788-d596-4dd8-b435-a811ca18f789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96a6788-d596-4dd8-b435-a811ca18f789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2adaff-d7bd-44e4-84df-930a0f847c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f2adaff-d7bd-44e4-84df-930a0f847c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fd8d16-1b67-47b7-89dc-ffa08c7c0d87', 'volume_name': 'volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8086ad1-2770-4ff6-8881-6f7e607b1623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8086ad1-2770-4ff6-8881-6f7e607b1623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2e6206-4765-4061-9577-e66e2b71d351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Volume 39fd8d16-1b67-47b7-89dc-ffa08c7c0d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87', 'volume_size': 1} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2123102876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fd8d16-1b67-47b7-89dc-ffa08c7c0d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e77bf89ad42a09159a4515b190424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:13Z,use_quota=True,user_id='4593a61c5fc743fcbad73b9262bf1b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Creating volume 39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:13 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:13 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 1073741824 Nov 01 09:48:13 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:13 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 1073741824" returned: 0 in 0.550s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:13 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 Nov 01 09:48:13 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:13 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87" returned: 0 in 0.299s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2e6206-4765-4061-9577-e66e2b71d351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbab5d0-e998-4f4d-8fbd-69e137f69a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:14 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Volume volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 (39fd8d16-1b67-47b7-89dc-ffa08c7c0d87): created successfully Nov 01 09:48:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbab5d0-e998-4f4d-8fbd-69e137f69a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Flow 'volume_create_manager' (40ce883e-11cf-4494-ac1c-0c5fda3d76d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7519c2dd-112c-456f-b51a-d72bd8358cfe tempest-ProjectReaderTests-787090626 None] Created volume successfully. Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Acquiring lock "cinder-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Lock "cinder-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=125,cinder:UPDATE=177,cinder:INSERT=49,cinder:DELETE=19 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=138,cinder:UPDATE=184,cinder:DELETE=13,cinder:INSERT=44 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Acquiring lock "cinder-quobyte-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Lock "cinder-quobyte-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bafa561-955c-467e-b8fb-f5fdf023aaa4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:15 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 Nov 01 09:48:15 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:15 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87" returned: 0 in 0.520s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:15 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87 Nov 01 09:48:15 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:16 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87" returned: 0 in 0.313s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Lock "cinder-quobyte-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87" released by "delete_volume" :: held 0.901s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Created reservations ['664f11d0-67a6-43b4-b990-1a00b7eba17f', '0a63e53b-3a2c-40fb-bf9c-1bc5446ce6ae', '7b48003f-1f49-409c-945d-1822da778fe9', '922367f6-0b22-4dcf-9e3f-b425e1388fa9'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:16 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:16 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:16 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Deleted volume successfully. Nov 01 09:48:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6cea06c4-5a18-4ad4-9fcf-9864a795db75 tempest-ProjectReaderTests-787090626 None] Lock "cinder-39fd8d16-1b67-47b7-89dc-ffa08c7c0d87-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Flow 'volume_create_manager' (f8b52f26-f65b-4b62-8f75-a22f58bc4603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb05de0-2f30-45cc-bd56-536cd927c8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb05de0-2f30-45cc-bd56-536cd927c8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2067467971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5db3d05-a1a9-476b-840d-9467ba103b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e77bf89ad42a09159a4515b190424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:17Z,use_quota=True,user_id='4593a61c5fc743fcbad73b9262bf1b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91ce0e3-0fed-4c19-a26b-b6c9d79ad4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91ce0e3-0fed-4c19-a26b-b6c9d79ad4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba29ccc0-ca9f-4c56-a74b-58c44fa674cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba29ccc0-ca9f-4c56-a74b-58c44fa674cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5db3d05-a1a9-476b-840d-9467ba103b0f', 'volume_name': 'volume-d5db3d05-a1a9-476b-840d-9467ba103b0f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b97ac5-a292-47cd-9b6f-510f8c8a962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b97ac5-a292-47cd-9b6f-510f8c8a962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714e0324-912c-4645-aebe-8992ed5ad9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Volume d5db3d05-a1a9-476b-840d-9467ba103b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5db3d05-a1a9-476b-840d-9467ba103b0f', 'volume_size': 1} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2067467971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5db3d05-a1a9-476b-840d-9467ba103b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e77bf89ad42a09159a4515b190424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:17Z,use_quota=True,user_id='4593a61c5fc743fcbad73b9262bf1b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Creating volume d5db3d05-a1a9-476b-840d-9467ba103b0f {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:17 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:17 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f 1073741824 Nov 01 09:48:17 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Flow 'volume_create_manager' (5c1856b2-1d19-4ab8-8a5d-8cd8120bc5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afd759d-1466-47f7-8de9-4428af57ddc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afd759d-1466-47f7-8de9-4428af57ddc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-910758436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db5e755-e321-4ca5-9943-18f238d91e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780006472f5b4ce2918cb9727d83bd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:17Z,use_quota=True,user_id='521af1ac246449bbb1cbcba172873f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3332dd5a-1894-4783-9cf2-ded007acb45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3332dd5a-1894-4783-9cf2-ded007acb45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be0cabb-8e46-4f65-aed3-86c27d3b864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be0cabb-8e46-4f65-aed3-86c27d3b864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db5e755-e321-4ca5-9943-18f238d91e75', 'volume_name': 'volume-5db5e755-e321-4ca5-9943-18f238d91e75', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92683e1-8244-4072-9797-39101a528d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92683e1-8244-4072-9797-39101a528d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157b58f4-5707-44ee-bcd2-7f171f1c008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:17 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Volume 5db5e755-e321-4ca5-9943-18f238d91e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db5e755-e321-4ca5-9943-18f238d91e75', 'volume_size': 1} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:17 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f 1073741824" returned: 0 in 0.528s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:17 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f Nov 01 09:48:17 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:18 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f" returned: 0 in 0.266s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-910758436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db5e755-e321-4ca5-9943-18f238d91e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780006472f5b4ce2918cb9727d83bd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:17Z,use_quota=True,user_id='521af1ac246449bbb1cbcba172873f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Creating volume 5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:18 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714e0324-912c-4645-aebe-8992ed5ad9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5db3d05-a1a9-476b-840d-9467ba103b0f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:18 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 1073741824 Nov 01 09:48:18 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4569b940-d156-4f22-8877-f193684451ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:18 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Volume volume-d5db3d05-a1a9-476b-840d-9467ba103b0f (d5db3d05-a1a9-476b-840d-9467ba103b0f): created successfully Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4569b940-d156-4f22-8877-f193684451ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Flow 'volume_create_manager' (f8b52f26-f65b-4b62-8f75-a22f58bc4603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d21f1a0d-e8cd-4a91-9e8d-8fd381ddd6db tempest-ProjectReaderTests-787090626 None] Created volume successfully. Nov 01 09:48:18 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 1073741824" returned: 0 in 0.499s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:18 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 Nov 01 09:48:18 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:18 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75" returned: 0 in 0.267s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (157b58f4-5707-44ee-bcd2-7f171f1c008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db5e755-e321-4ca5-9943-18f238d91e75', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713e0ef2-bc52-4f4a-880b-6775048cd111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:18 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Volume volume-5db5e755-e321-4ca5-9943-18f238d91e75 (5db5e755-e321-4ca5-9943-18f238d91e75): created successfully Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713e0ef2-bc52-4f4a-880b-6775048cd111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Flow 'volume_create_manager' (5c1856b2-1d19-4ab8-8a5d-8cd8120bc5ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-cb4b4a50-92e9-45b3-853b-720c1c5cbd0a tempest-SnapshotDependencyTests-1702473760 None] Created volume successfully. Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Acquiring lock "cinder-d5db3d05-a1a9-476b-840d-9467ba103b0f-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Lock "cinder-d5db3d05-a1a9-476b-840d-9467ba103b0f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Acquiring lock "cinder-quobyte-d5db3d05-a1a9-476b-840d-9467ba103b0f" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Lock "cinder-quobyte-d5db3d05-a1a9-476b-840d-9467ba103b0f" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[06aaea3e-e9f3-40e5-832f-bd65b434c6fe]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:19 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f Nov 01 09:48:19 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Creating offline snapshot 4b60e770-d942-41ff-9edc-e84e1c3345d3 of volume 5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a43888-c0fb-44fb-9e19-4264a8870dbf]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:19 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f" returned: 0 in 0.463s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:19 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f Nov 01 09:48:19 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:19 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 Nov 01 09:48:19 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:20 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d5db3d05-a1a9-476b-840d-9467ba103b0f" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Lock "cinder-quobyte-d5db3d05-a1a9-476b-840d-9467ba103b0f" released by "delete_volume" :: held 0.822s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:20 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75" returned: 0 in 0.392s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:20 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 1G Nov 01 09:48:20 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Created reservations ['9ee5d370-c949-4e8d-8905-58d90f8084cf', '942f8a7a-654d-4cf3-9a41-5c7f0c5503d7', 'e28acf4c-bb40-4dc0-a036-f3e5aaa8e5cb', 'd04ed268-7cc9-431a-a2d7-28e13c61d807'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:20 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:20 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:20 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.327s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Deleted volume successfully. Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8cd36eac-efff-4e3c-90dc-2c0a58319ea2 tempest-ProjectReaderTests-787090626 None] Lock "cinder-d5db3d05-a1a9-476b-840d-9467ba103b0f-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:20 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 1G" returned: 0 in 0.525s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db5e755-e321-4ca5-9943-18f238d91e75 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:20 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db5e755-e321-4ca5-9943-18f238d91e75 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 Nov 01 09:48:20 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:20 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:20 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Flow 'volume_create_manager' (31886adf-318f-4d13-b72b-6716a478b3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aedeb83-0c0c-4893-877d-3d287c50c3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db5e755-e321-4ca5-9943-18f238d91e75 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3" returned: 0 in 0.358s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:21 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 is being set with open permissions: ugo+rw Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aedeb83-0c0c-4893-877d-3d287c50c3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355601725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3300e44a-e440-41d7-96ba-70f5f06fe348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e77bf89ad42a09159a4515b190424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:21Z,use_quota=True,user_id='4593a61c5fc743fcbad73b9262bf1b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:21 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7eb7c0-a547-43eb-a0b5-9e2cb103d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:21 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc7eb7c0-a547-43eb-a0b5-9e2cb103d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13008568-cb34-4613-bc05-f586d4640ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13008568-cb34-4613-bc05-f586d4640ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3300e44a-e440-41d7-96ba-70f5f06fe348', 'volume_name': 'volume-3300e44a-e440-41d7-96ba-70f5f06fe348', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07fc774-963f-4b5c-9e75-1801880ea5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07fc774-963f-4b5c-9e75-1801880ea5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139b7772-7062-4ec2-b07d-eb6b3526a39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:21 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Volume 3300e44a-e440-41d7-96ba-70f5f06fe348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3300e44a-e440-41d7-96ba-70f5f06fe348', 'volume_size': 1} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:21 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3" returned: 0 in 0.266s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:21 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.info Nov 01 09:48:21 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:21 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.info" returned: 0 in 0.263s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:21 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.info is being set with open permissions: ugo+rw Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:21 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.info Nov 01 09:48:21 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:21 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.info" returned: 0 in 0.262s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.783s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355601725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3300e44a-e440-41d7-96ba-70f5f06fe348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881e77bf89ad42a09159a4515b190424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:21Z,use_quota=True,user_id='4593a61c5fc743fcbad73b9262bf1b85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Creating volume 3300e44a-e440-41d7-96ba-70f5f06fe348 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:21 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:21 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 1073741824 Nov 01 09:48:21 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-35cc15fe-b875-4879-8b18-85922d9ecf51 tempest-SnapshotDependencyTests-1702473760 None] Create snapshot completed successfully Nov 01 09:48:22 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 1073741824" returned: 0 in 0.458s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:22 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 Nov 01 09:48:22 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:22 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348" returned: 0 in 0.257s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139b7772-7062-4ec2-b07d-eb6b3526a39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3300e44a-e440-41d7-96ba-70f5f06fe348', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0848cb92-e170-4c0f-9a8d-cdc9ab78c036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:22 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Volume volume-3300e44a-e440-41d7-96ba-70f5f06fe348 (3300e44a-e440-41d7-96ba-70f5f06fe348): created successfully Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0848cb92-e170-4c0f-9a8d-cdc9ab78c036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Flow 'volume_create_manager' (31886adf-318f-4d13-b72b-6716a478b3ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a0cba1b6-068e-4d73-a463-4a8f820c81c8 tempest-ProjectReaderTests-787090626 None] Created volume successfully. Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Acquiring lock "cinder-3300e44a-e440-41d7-96ba-70f5f06fe348-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Lock "cinder-3300e44a-e440-41d7-96ba-70f5f06fe348-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Flow 'volume_create_manager' (6e3ec897-e9b4-435b-8d76-cf6e0d8bbc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca213b2d-06f0-4748-85d0-78614d116f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca213b2d-06f0-4748-85d0-78614d116f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1065835531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e21cb95-576b-465e-8900-d008a0ce3dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3468f5e95d6749629b94b6020a882d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:23Z,use_quota=True,user_id='f26266a6709f40d2afe7d09d9e8bbb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98aa92ea-e8ec-4f22-b776-bf222cff028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98aa92ea-e8ec-4f22-b776-bf222cff028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39b3208-5873-414e-81a9-e0a2acb37fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Acquiring lock "cinder-quobyte-3300e44a-e440-41d7-96ba-70f5f06fe348" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Lock "cinder-quobyte-3300e44a-e440-41d7-96ba-70f5f06fe348" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e012dfa-a6e0-4821-824f-3d645b63114a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:23 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 Nov 01 09:48:23 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Flow 'volume_create_manager' (4f418208-cf01-4aa6-872f-dfd1942feb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85da5542-c699-486e-bdcc-8b3b058d0c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85da5542-c699-486e-bdcc-8b3b058d0c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd25ad09-0b2b-40cd-a756-e59b285c5b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='780006472f5b4ce2918cb9727d83bd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4b60e770-d942-41ff-9edc-e84e1c3345d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:23Z,use_quota=True,user_id='521af1ac246449bbb1cbcba172873f2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d346425-ef94-4eb4-a0c4-60c35b4cdf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d346425-ef94-4eb4-a0c4-60c35b4cdf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502792f0-183a-475e-bb64-cc2df8c4a627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (502792f0-183a-475e-bb64-cc2df8c4a627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd25ad09-0b2b-40cd-a756-e59b285c5b5c', 'volume_name': 'volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c', 'volume_size': 1, 'snapshot_id': '4b60e770-d942-41ff-9edc-e84e1c3345d3'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b962a6-b70e-49a1-86d7-96238cff9180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2b962a6-b70e-49a1-86d7-96238cff9180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0e557e-bc1c-42d6-a683-48129b4faf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Volume dd25ad09-0b2b-40cd-a756-e59b285c5b5c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c', 'volume_size': 1, 'snapshot_id': '4b60e770-d942-41ff-9edc-e84e1c3345d3'} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-quobyte-4b60e770-d942-41ff-9edc-e84e1c3345d3-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b39b3208-5873-414e-81a9-e0a2acb37fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e21cb95-576b-465e-8900-d008a0ce3dce', 'volume_name': 'volume-8e21cb95-576b-465e-8900-d008a0ce3dce', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f85d8a-2f30-4eb1-bf41-6294e42baf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f85d8a-2f30-4eb1-bf41-6294e42baf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edeb1045-f092-4c9f-ad8d-a3744f14a512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Volume 8e21cb95-576b-465e-8900-d008a0ce3dce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e21cb95-576b-465e-8900-d008a0ce3dce', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Trying to clone 8e21cb95-576b-465e-8900-d008a0ce3dce from image c507ec59-c87f-4d5c-be6c-eab60d7c916d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-4b60e770-d942-41ff-9edc-e84e1c3345d3-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Creating volume dd25ad09-0b2b-40cd-a756-e59b285c5b5c from snapshot 4b60e770-d942-41ff-9edc-e84e1c3345d3 {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-quobyte-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] snapshot: 4b60e770-d942-41ff-9edc-e84e1c3345d3, volume: dd25ad09-0b2b-40cd-a756-e59b285c5b5c, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a6eaec-ccf1-4083-8221-3fb5a1dca4de]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:23 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348" returned: 0 in 0.480s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:23 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 Nov 01 09:48:23 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:23 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348 Nov 01 09:48:23 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:48:24 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Image download 20.69 MB at 20.69 MB/s Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28c9cfe-99ae-4f06-858a-268db8ac0315]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:24 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3" returned: 0 in 0.440s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5db5e755-e321-4ca5-9943-18f238d91e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:48:24 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3300e44a-e440-41d7-96ba-70f5f06fe348" returned: 0 in 0.345s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c18e69-323d-45ea-97bf-9b06bfdbc9be]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Lock "cinder-quobyte-3300e44a-e440-41d7-96ba-70f5f06fe348" released by "delete_volume" :: held 0.905s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:24 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD Nov 01 09:48:24 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Created reservations ['831f535c-c9b4-4fb6-9fe5-6d40270fc530', '277d9550-ca2b-4015-b74c-d3eb31ef447c', '0f2e8578-fcad-47c8-b58b-03ebc40b3f76', '10f02d6d-4862-4ccc-847d-10abe9dafb53'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:24 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 Nov 01 09:48:24 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:24 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:24 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:24 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d is fetched for user f26266a6709f40d2afe7d09d9e8bbb75. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c375c3b2-5ccc-4800-9537-501664acbe85]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:24 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:24 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75" returned: 0 in 0.422s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.290s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:24 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Deleted volume successfully. Nov 01 09:48:24 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c Nov 01 09:48:24 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c1cd4a8f-7175-4cf6-a911-291cbaf33976 tempest-ProjectReaderTests-787090626 None] Lock "cinder-3300e44a-e440-41d7-96ba-70f5f06fe348-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:24 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD Nov 01 09:48:24 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:24 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:31 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" returned: 0 in 6.712s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:48:31 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Converted 1024.00 MB image at 152.54 MB/s Nov 01 09:48:31 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c is being set with open permissions: ugo+rw Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:31 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c Nov 01 09:48:31 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:31 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" returned: 0 in 0.236s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" released by "_copy_volume_from_snapshot" :: held 7.905s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-4b60e770-d942-41ff-9edc-e84e1c3345d3-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" released by "_create_volume_from_snapshot" :: held 7.966s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.022s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.679s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1065835531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e21cb95-576b-465e-8900-d008a0ce3dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3468f5e95d6749629b94b6020a882d25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:23Z,use_quota=True,user_id='f26266a6709f40d2afe7d09d9e8bbb75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Creating volume 8e21cb95-576b-465e-8900-d008a0ce3dce {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:31 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:31 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce 1073741824 Nov 01 09:48:31 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0e557e-bc1c-42d6-a683-48129b4faf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c', 'volume_size': 1, 'snapshot_id': '4b60e770-d942-41ff-9edc-e84e1c3345d3'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1674335-0240-485f-9aa2-d69fe6362dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:31 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Volume volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c (dd25ad09-0b2b-40cd-a756-e59b285c5b5c): created successfully Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1674335-0240-485f-9aa2-d69fe6362dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Flow 'volume_create_manager' (4f418208-cf01-4aa6-872f-dfd1942feb43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-48180e96-69f4-4eae-ac29-9a4a9d3bb003 tempest-SnapshotDependencyTests-1702473760 None] Created volume successfully. Nov 01 09:48:32 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce 1073741824" returned: 0 in 0.413s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:32 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce Nov 01 09:48:32 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-4b60e770-d942-41ff-9edc-e84e1c3345d3-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-4b60e770-d942-41ff-9edc-e84e1c3345d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-quobyte-5db5e755-e321-4ca5-9943-18f238d91e75" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-5db5e755-e321-4ca5-9943-18f238d91e75" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-quobyte-4b60e770-d942-41ff-9edc-e84e1c3345d3" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-4b60e770-d942-41ff-9edc-e84e1c3345d3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Deleting offline snapshot 4b60e770-d942-41ff-9edc-e84e1c3345d3 of volume 5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] snapshot_file for this snap is: volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15610ab-db89-42be-b422-7f182ab24987]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:32 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:32 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 Nov 01 09:48:32 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Attempting download of c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 8e21cb95-576b-465e-8900-d008a0ce3dce. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e1fc05-55d2-42ea-9ad8-d117ee77b32a]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_421si8sk {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:32 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_421si8sk Nov 01 09:48:32 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:32 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3" returned: 0 in 0.367s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5db5e755-e321-4ca5-9943-18f238d91e75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd2afe2-1bdd-4ed1-9b37-2788b55e0014]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:32 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 Nov 01 09:48:32 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:32 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_421si8sk" returned: 0 in 0.339s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_421si8sk {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:32 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_421si8sk Nov 01 09:48:32 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:33 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_421si8sk" returned: 1 in 0.329s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_421si8sk' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d3f75c-6cef-449b-938b-fb5ac8879497]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:33 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75" returned: 0 in 0.522s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:33 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 Nov 01 09:48:33 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:33 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD Nov 01 09:48:33 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:33 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] c507ec59-c87f-4d5c-be6c-eab60d7c916d was qcow2, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:33 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce Nov 01 09:48:33 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:33 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:33 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3 Nov 01 09:48:33 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:33 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75.4b60e770-d942-41ff-9edc-e84e1c3345d3" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-4b60e770-d942-41ff-9edc-e84e1c3345d3" released by "_delete_snapshot" :: held 1.607s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-5db5e755-e321-4ca5-9943-18f238d91e75" released by "delete_snapshot" :: held 1.629s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Created reservations ['583eb5e5-d443-457b-afd2-bebb99fb83b3', 'b6342e4c-72d2-4043-9180-f0957634dc34', '90fe6ab2-0139-4524-b83d-1590d7d25f7b', 'b6f8708d-b2f7-474a-ac28-257b1179a1b2'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Delete snapshot completed successfully. Nov 01 09:48:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d9c3991e-e8d5-47d9-88d4-d15a9c07b6cd tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-4b60e770-d942-41ff-9edc-e84e1c3345d3-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-5db5e755-e321-4ca5-9943-18f238d91e75-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-5db5e755-e321-4ca5-9943-18f238d91e75-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-quobyte-5db5e755-e321-4ca5-9943-18f238d91e75" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-5db5e755-e321-4ca5-9943-18f238d91e75" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:34 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e098bf-069e-4e89-b849-b673b41c1d7b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:34 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 Nov 01 09:48:34 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:34 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75" returned: 0 in 0.438s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:35 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75 Nov 01 09:48:35 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:35 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5db5e755-e321-4ca5-9943-18f238d91e75" returned: 0 in 0.254s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-5db5e755-e321-4ca5-9943-18f238d91e75" released by "delete_volume" :: held 0.766s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Created reservations ['868e2709-7243-46f3-babb-50a045fa7ec7', '117c1a2e-aeaa-4f1c-8e33-6379203bea42', '17f24b82-a8be-4b00-81bd-aa009ef6fa37', 'd67bd088-2a68-4b9f-b9c3-53a5ebd9819d'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:35 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce" returned: 0 in 1.908s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d_4ac0yfindevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:48:35 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Converted 112.00 MB image at 58.61 MB/s Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:35 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:35 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:35 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce 1G Nov 01 09:48:35 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-dd25ad09-0b2b-40cd-a756-e59b285c5b5c-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-dd25ad09-0b2b-40cd-a756-e59b285c5b5c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:35 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "cinder-quobyte-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Deleted volume successfully. Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-36d1ef82-a67c-436e-9c8e-c27ade711d55 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-5db5e755-e321-4ca5-9943-18f238d91e75-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45b763a-5e61-4d46-a1a6-c31f08f13f5e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:35 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce 1G" returned: 0 in 0.361s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Downloaded image c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 8e21cb95-576b-465e-8900-d008a0ce3dce successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d for user f26266a6709f40d2afe7d09d9e8bbb75 is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Marking volume 8e21cb95-576b-465e-8900-d008a0ce3dce as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Copying metadata from image c507ec59-c87f-4d5c-be6c-eab60d7c916d to 8e21cb95-576b-465e-8900-d008a0ce3dce. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Creating volume glance metadata for volume 8e21cb95-576b-465e-8900-d008a0ce3dce backed by image c507ec59-c87f-4d5c-be6c-eab60d7c916d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:48:35 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c Nov 01 09:48:35 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edeb1045-f092-4c9f-ad8d-a3744f14a512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e21cb95-576b-465e-8900-d008a0ce3dce', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721fbb96-c484-4851-9919-025240a4c67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:35 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Volume volume-8e21cb95-576b-465e-8900-d008a0ce3dce (8e21cb95-576b-465e-8900-d008a0ce3dce): created successfully Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721fbb96-c484-4851-9919-025240a4c67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Flow 'volume_create_manager' (6e3ec897-e9b4-435b-8d76-cf6e0d8bbc4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2e7230b8-1352-4ce4-af90-bdc1a23b085e tempest-VolumesImageMetadata-2121241176 None] Created volume successfully. Nov 01 09:48:36 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" returned: 0 in 0.369s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:36 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c Nov 01 09:48:36 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:36 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" returned: 0 in 0.259s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-quobyte-dd25ad09-0b2b-40cd-a756-e59b285c5b5c" released by "delete_volume" :: held 0.673s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Created reservations ['f5768a3c-8810-4e78-8da6-82a6a03760e3', '53fa6a44-284f-4bf7-84ae-4767d47634af', '398ee95e-29a5-449d-b5d5-2db9d7ed3f76', '70903d60-bca7-442d-909c-0b4eee469201'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:36 devstack sudo[103086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:36 devstack sudo[103086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:36 devstack sudo[103086]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.258s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Acquiring lock "cinder-8e21cb95-576b-465e-8900-d008a0ce3dce-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Deleted volume successfully. Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Lock "cinder-8e21cb95-576b-465e-8900-d008a0ce3dce-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ac3ce0b1-8e57-4255-b078-1c190ef6caa9 tempest-SnapshotDependencyTests-1702473760 None] Lock "cinder-dd25ad09-0b2b-40cd-a756-e59b285c5b5c-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Acquiring lock "cinder-quobyte-8e21cb95-576b-465e-8900-d008a0ce3dce" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Lock "cinder-quobyte-8e21cb95-576b-465e-8900-d008a0ce3dce" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74e1be6-7f19-4776-b1c2-23ef0c12f797]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:36 devstack sudo[103089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce Nov 01 09:48:36 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:37 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce" returned: 0 in 0.373s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:37 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce Nov 01 09:48:37 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:37 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e21cb95-576b-465e-8900-d008a0ce3dce" returned: 0 in 0.266s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Lock "cinder-quobyte-8e21cb95-576b-465e-8900-d008a0ce3dce" released by "delete_volume" :: held 0.707s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Created reservations ['7ed3579a-6247-4b90-a845-ff583aab2feb', '0d34f8db-6afd-482a-b314-a25dda0d6c18', '2f011bce-3aaf-4636-b7e6-95dc88022ab0', '4d6c9a6c-2058-46ed-a7dd-c395c4176b8d'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:37 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:37 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:37 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.270s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Deleted volume successfully. Nov 01 09:48:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9e1fa764-417c-4255-85c7-a0fa403adde2 tempest-VolumesImageMetadata-2121241176 None] Lock "cinder-8e21cb95-576b-465e-8900-d008a0ce3dce-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Flow 'volume_create_manager' (a91af8ff-5d8e-47b7-8d21-aef017d0b889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2704ea54-149f-41c5-a936-e38b2120c86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2704ea54-149f-41c5-a936-e38b2120c86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1623928844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc4335f-fdd4-41d2-a97b-02c873a9056c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4274574c344851969bfb2225a1cb43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:45Z,use_quota=True,user_id='728050a4d2814c3baf54b3ba8232fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3186da5-4312-49e8-8d21-6bb47a863793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3186da5-4312-49e8-8d21-6bb47a863793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b5b645-9c49-4d30-bf92-c80fa1768cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b5b645-9c49-4d30-bf92-c80fa1768cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc4335f-fdd4-41d2-a97b-02c873a9056c', 'volume_name': 'volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f978d99-9b72-472e-ac60-04442ed8e756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f978d99-9b72-472e-ac60-04442ed8e756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3130e5-cca4-45b8-bafa-b690a26b68f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:45 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Volume 5dc4335f-fdd4-41d2-a97b-02c873a9056c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c', 'volume_size': 1} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1623928844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc4335f-fdd4-41d2-a97b-02c873a9056c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4274574c344851969bfb2225a1cb43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:45Z,use_quota=True,user_id='728050a4d2814c3baf54b3ba8232fabe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Creating volume 5dc4335f-fdd4-41d2-a97b-02c873a9056c {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:45 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:45 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c 1073741824 Nov 01 09:48:45 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:45 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c 1073741824" returned: 0 in 0.503s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:45 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c Nov 01 09:48:45 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:45 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c" returned: 0 in 0.270s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3130e5-cca4-45b8-bafa-b690a26b68f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a91ca9-7e86-46e4-b70a-9b43bf57758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:45 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Volume volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c (5dc4335f-fdd4-41d2-a97b-02c873a9056c): created successfully Nov 01 09:48:45 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a91ca9-7e86-46e4-b70a-9b43bf57758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Flow 'volume_create_manager' (a91af8ff-5d8e-47b7-8d21-aef017d0b889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-914b588d-1297-4a7c-add0-417bdc6664b5 tempest-VolumesMetadataTest-1634869630 None] Created volume successfully. Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Acquiring lock "cinder-5dc4335f-fdd4-41d2-a97b-02c873a9056c-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Lock "cinder-5dc4335f-fdd4-41d2-a97b-02c873a9056c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Acquiring lock "cinder-quobyte-5dc4335f-fdd4-41d2-a97b-02c873a9056c" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Lock "cinder-quobyte-5dc4335f-fdd4-41d2-a97b-02c873a9056c" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8ca2d6-6c71-4f35-971b-e4dec4dcf202]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:48 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c Nov 01 09:48:48 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:48 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c" returned: 0 in 0.366s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:48 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c Nov 01 09:48:48 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:48 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5dc4335f-fdd4-41d2-a97b-02c873a9056c" returned: 0 in 0.251s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Lock "cinder-quobyte-5dc4335f-fdd4-41d2-a97b-02c873a9056c" released by "delete_volume" :: held 0.659s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Created reservations ['de3d1b24-c35c-44ae-bdc3-316f8691043d', '1036861d-daa5-41e9-9654-fa7c9ed8d9b1', 'cabcb01c-fbeb-43e4-b969-9cd1c339dc48', '7e3cb29a-9abc-4296-9215-d28f77c85da6'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:48 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:48 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:49 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.244s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:49 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Deleted volume successfully. Nov 01 09:48:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8656a298-90a4-45b8-ade5-25432d64eac9 tempest-VolumesMetadataTest-1634869630 None] Lock "cinder-5dc4335f-fdd4-41d2-a97b-02c873a9056c-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:53 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:53 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:53 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.251s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Flow 'volume_create_manager' (7a629d16-b803-45da-9975-3f13f467d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160d2be7-26ef-4617-885b-ca5b1549042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160d2be7-26ef-4617-885b-ca5b1549042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1041395237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c3711e-4ced-4ab0-95d9-96a2d1029b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cef3244b5e481ca74bfae44aab8d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:54Z,use_quota=True,user_id='dd796363bd6b43e58bee9ec281c3e4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5632436-8bb3-454e-aeb0-8bf04a3e0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5632436-8bb3-454e-aeb0-8bf04a3e0436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f59717-bf9c-4ec7-9e4d-1f288e1ee8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f59717-bf9c-4ec7-9e4d-1f288e1ee8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c3711e-4ced-4ab0-95d9-96a2d1029b5f', 'volume_name': 'volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20eeefeb-c991-4b5f-91a7-e6a36d236727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20eeefeb-c991-4b5f-91a7-e6a36d236727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a11bf14-01f6-4889-aaba-2a59f79ce9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:53 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Volume a9c3711e-4ced-4ab0-95d9-96a2d1029b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f', 'volume_size': 1} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1041395237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c3711e-4ced-4ab0-95d9-96a2d1029b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cef3244b5e481ca74bfae44aab8d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:54Z,use_quota=True,user_id='dd796363bd6b43e58bee9ec281c3e4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Creating volume a9c3711e-4ced-4ab0-95d9-96a2d1029b5f {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:53 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:54 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f 1073741824 Nov 01 09:48:54 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:54 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f 1073741824" returned: 0 in 0.419s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:54 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f Nov 01 09:48:54 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:54 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a11bf14-01f6-4889-aaba-2a59f79ce9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38959124-2fe4-4575-80e1-6121febe8fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:54 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Volume volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f (a9c3711e-4ced-4ab0-95d9-96a2d1029b5f): created successfully Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38959124-2fe4-4575-80e1-6121febe8fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:54 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Flow 'volume_create_manager' (7a629d16-b803-45da-9975-3f13f467d93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:54 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a3a4cdc5-bce2-43a5-9ae3-351e456b78dc tempest-VolumesTransfersTest-739571662 None] Created volume successfully. Nov 01 09:48:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c67bab69-8a4e-4141-9dd8-c8179895a778 tempest-VolumesTransfersTest-308110105 None] Transfer volume completed successfully. Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Acquiring lock "cinder-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Lock "cinder-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Acquiring lock "cinder-quobyte-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Lock "cinder-quobyte-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ced20d-fb9e-4105-b03e-d7b46bf0ab45]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:56 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f Nov 01 09:48:56 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:56 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:56 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f Nov 01 09:48:56 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:56 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f" returned: 0 in 0.247s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Lock "cinder-quobyte-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f" released by "delete_volume" :: held 0.644s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Created reservations ['4f8cb3e9-3f58-4016-9221-b9acb83275d0', 'c762228f-e9f8-43fb-8548-c80ad581fb36', 'fdd2c718-d502-4771-b45b-1794670fb345', '024fd55f-f698-42ff-914d-16b4e37b90f3'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:56 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:56 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:57 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.240s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:57 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Deleted volume successfully. Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-df3e8edc-2faf-44f5-8609-0c7f76f81931 tempest-VolumesTransfersTest-1854636675 None] Lock "cinder-a9c3711e-4ced-4ab0-95d9-96a2d1029b5f-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Flow 'volume_create_manager' (21e7844f-cc6c-48d6-912a-4c0efb3233d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfa1686-2e09-4226-960e-dd6a2a41d10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfa1686-2e09-4226-960e-dd6a2a41d10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1715658149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0147cb-e221-4e03-a764-3c51cda867e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cef3244b5e481ca74bfae44aab8d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:58Z,use_quota=True,user_id='dd796363bd6b43e58bee9ec281c3e4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e204c9bd-3f4b-4fe9-8224-f4ff2e0cf467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e204c9bd-3f4b-4fe9-8224-f4ff2e0cf467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58a9540-3d24-48f7-ae5b-4ef569c89535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58a9540-3d24-48f7-ae5b-4ef569c89535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb0147cb-e221-4e03-a764-3c51cda867e4', 'volume_name': 'volume-eb0147cb-e221-4e03-a764-3c51cda867e4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e52e03-61cb-4eca-872d-276edee0ed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e52e03-61cb-4eca-872d-276edee0ed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa5636c-f11f-46cc-b9cf-962de55ca793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:57 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Volume eb0147cb-e221-4e03-a764-3c51cda867e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb0147cb-e221-4e03-a764-3c51cda867e4', 'volume_size': 1} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1715658149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb0147cb-e221-4e03-a764-3c51cda867e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cef3244b5e481ca74bfae44aab8d59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:48:58Z,use_quota=True,user_id='dd796363bd6b43e58bee9ec281c3e4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Creating volume eb0147cb-e221-4e03-a764-3c51cda867e4 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:48:57 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:48:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:57 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 1073741824 Nov 01 09:48:57 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:58 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 1073741824" returned: 0 in 0.418s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:58 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 Nov 01 09:48:58 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:58 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4" returned: 0 in 0.243s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfa5636c-f11f-46cc-b9cf-962de55ca793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb0147cb-e221-4e03-a764-3c51cda867e4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2460ae42-f64f-4925-9e9d-94ad0b837163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:48:58 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Volume volume-eb0147cb-e221-4e03-a764-3c51cda867e4 (eb0147cb-e221-4e03-a764-3c51cda867e4): created successfully Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2460ae42-f64f-4925-9e9d-94ad0b837163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Flow 'volume_create_manager' (21e7844f-cc6c-48d6-912a-4c0efb3233d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:48:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f4506525-e71a-4d24-9d52-fafe1f6cca3f tempest-VolumesTransfersTest-739571662 None] Created volume successfully. Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Acquiring lock "cinder-eb0147cb-e221-4e03-a764-3c51cda867e4-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Lock "cinder-eb0147cb-e221-4e03-a764-3c51cda867e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Acquiring lock "cinder-quobyte-eb0147cb-e221-4e03-a764-3c51cda867e4" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Lock "cinder-quobyte-eb0147cb-e221-4e03-a764-3c51cda867e4" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b8fa3a-57a7-484f-804b-c7f43f0f1f3b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:48:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:59 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 Nov 01 09:48:59 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:59 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4" returned: 0 in 0.359s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:59 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4 Nov 01 09:48:59 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:59 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-eb0147cb-e221-4e03-a764-3c51cda867e4" returned: 0 in 0.259s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Lock "cinder-quobyte-eb0147cb-e221-4e03-a764-3c51cda867e4" released by "delete_volume" :: held 0.661s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Created reservations ['4ed3b198-8451-4713-8740-755e438e9679', '1c8c8037-89db-49f4-a60c-46fc02fd7a57', 'a7ee9edf-7608-47ff-8346-46a64fa4136b', '18ee33ad-a8e6-4618-9aa6-e503942ee74c'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:48:59 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:48:59 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:48:59 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.243s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:48:59 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:48:59 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Deleted volume successfully. Nov 01 09:49:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba8a3302-9b96-4f7b-a786-ba2ad47be049 tempest-VolumesTransfersTest-1854636675 None] Lock "cinder-eb0147cb-e221-4e03-a764-3c51cda867e4-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (52cdcdd4-451d-47bd-a75d-05703b079f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309b06ad-3061-478a-9c27-5950814c0193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309b06ad-3061-478a-9c27-5950814c0193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-251632292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:06Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad5a184-dcf7-42b3-87a1-ae8e1d39fea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad5a184-dcf7-42b3-87a1-ae8e1d39fea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45357e7-7e30-4e72-aafe-325be25b5b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45357e7-7e30-4e72-aafe-325be25b5b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19', 'volume_name': 'volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657dff43-6d28-41ce-9762-615d704d0645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657dff43-6d28-41ce-9762-615d704d0645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bc25fc-187a-42d9-80b7-78fa3620ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:05 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Volume 39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19', 'volume_size': 1} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-251632292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:06Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Creating volume 39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:49:05 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:49:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:05 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 1073741824 Nov 01 09:49:05 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:06 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 1073741824" returned: 0 in 0.409s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:06 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 Nov 01 09:49:06 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:06 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bc25fc-187a-42d9-80b7-78fa3620ef42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63484a33-256d-418e-8e3e-e49908e6d1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:06 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Volume volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 (39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19): created successfully Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63484a33-256d-418e-8e3e-e49908e6d1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (52cdcdd4-451d-47bd-a75d-05703b079f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6ebbdeb9-d186-4c9f-851a-546d7f051c7c tempest-VolumesGetTest-2018382785 None] Created volume successfully. Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (16c68587-7154-4adc-a7c4-4e82333c0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2777cea1-7693-443f-b764-4bafe8145c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2777cea1-7693-443f-b764-4bafe8145c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2038876024',display_name='tempest-VolumesGetTest-Volume-42492723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a5307c-824f-400b-819e-a3ccd2d3e746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:07Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221f6380-5acd-4a8f-8e8e-27a33f3679d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (221f6380-5acd-4a8f-8e8e-27a33f3679d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a20428-87e8-4705-bf1b-18a460a8317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a20428-87e8-4705-bf1b-18a460a8317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a5307c-824f-400b-819e-a3ccd2d3e746', 'volume_name': 'volume-b4a5307c-824f-400b-819e-a3ccd2d3e746', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05005e0-f55b-4fcb-8428-5d2e8d15a63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a05005e0-f55b-4fcb-8428-5d2e8d15a63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f776a55-0069-4916-bf1b-5c30c5df4c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:07 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Volume b4a5307c-824f-400b-819e-a3ccd2d3e746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a5307c-824f-400b-819e-a3ccd2d3e746', 'volume_size': 1} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2038876024',display_name='tempest-VolumesGetTest-Volume-42492723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a5307c-824f-400b-819e-a3ccd2d3e746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:07Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Creating volume b4a5307c-824f-400b-819e-a3ccd2d3e746 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:49:07 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:07 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 1073741824 Nov 01 09:49:07 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:07 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 1073741824" returned: 0 in 0.417s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:07 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 Nov 01 09:49:07 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:08 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746" returned: 0 in 0.243s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f776a55-0069-4916-bf1b-5c30c5df4c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a5307c-824f-400b-819e-a3ccd2d3e746', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b1ed43-89a0-48e8-aa45-97bee5e4925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:08 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Volume volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 (b4a5307c-824f-400b-819e-a3ccd2d3e746): created successfully Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b1ed43-89a0-48e8-aa45-97bee5e4925c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (16c68587-7154-4adc-a7c4-4e82333c0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:08 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e22403f1-f302-49d2-bc35-fbdb4074463f tempest-VolumesGetTest-2018382785 None] Created volume successfully. Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-b4a5307c-824f-400b-819e-a3ccd2d3e746-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Lock "cinder-b4a5307c-824f-400b-819e-a3ccd2d3e746-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-b4a5307c-824f-400b-819e-a3ccd2d3e746" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-b4a5307c-824f-400b-819e-a3ccd2d3e746" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97cb0ef-5d7b-4e9e-8dd8-58ea174bfab5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:08 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 Nov 01 09:49:08 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:08 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746" returned: 0 in 0.379s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:08 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746 Nov 01 09:49:08 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:09 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b4a5307c-824f-400b-819e-a3ccd2d3e746" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-b4a5307c-824f-400b-819e-a3ccd2d3e746" released by "delete_volume" :: held 0.661s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Created reservations ['6d77f469-8b1d-4302-b139-f67fd3a877b8', '4319c928-c511-4ff9-b160-10e366f1a3ea', '6136bc61-9560-4335-a979-0687449fb700', 'd969e9df-8182-444e-adc3-51f0ed6e9859'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:09 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:49:09 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:09 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:49:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Deleted volume successfully. Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3d2b8b3-d003-4dde-9030-040b8dfc5eb6 tempest-VolumesGetTest-2018382785 None] Lock "cinder-b4a5307c-824f-400b-819e-a3ccd2d3e746-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Lock "cinder-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0472da8-17fd-4b2f-b37f-591bc8426cce]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:09 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 Nov 01 09:49:09 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:10 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19" returned: 0 in 0.365s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:10 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19 Nov 01 09:49:10 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:10 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19" released by "delete_volume" :: held 0.656s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Created reservations ['1398db97-50fa-4dbf-b14c-ff9a7f55645c', 'ab86b519-09fb-45f8-a51c-4728ba99f629', '5bbe55b5-fe54-4235-be6f-44ed949b05b1', '9448a660-98b1-42ec-ab0f-916481916729'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:10 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:49:10 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:10 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.246s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:49:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Deleted volume successfully. Nov 01 09:49:10 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a25c3923-362b-4373-800c-458275644729 tempest-VolumesGetTest-2018382785 None] Lock "cinder-39fec850-a31b-4ddd-a1f3-5ed2c2d0ca19-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (f302694c-c46a-494f-9311-947bab4e539f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad42050-e3fe-403b-8b22-d7ede87038bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad42050-e3fe-403b-8b22-d7ede87038bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1891503575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f413e89-2957-43c8-8186-f33fc531139d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:11Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8b9a75-6184-44c5-b84a-0d0ea5d1543b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8b9a75-6184-44c5-b84a-0d0ea5d1543b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2e7548-e242-4e44-9ffd-9208b4c70d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2e7548-e242-4e44-9ffd-9208b4c70d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f413e89-2957-43c8-8186-f33fc531139d', 'volume_name': 'volume-7f413e89-2957-43c8-8186-f33fc531139d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4290a4-28c3-42cd-a622-dd864fad601e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4290a4-28c3-42cd-a622-dd864fad601e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420a1286-8b90-493c-a755-f32dadd22175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:11 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Volume 7f413e89-2957-43c8-8186-f33fc531139d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f413e89-2957-43c8-8186-f33fc531139d', 'volume_size': 1} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1891503575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f413e89-2957-43c8-8186-f33fc531139d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:11Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Creating volume 7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:49:11 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:11 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d 1073741824 Nov 01 09:49:11 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:11 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d 1073741824" returned: 0 in 0.412s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:11 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d Nov 01 09:49:11 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:12 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d" returned: 0 in 0.241s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420a1286-8b90-493c-a755-f32dadd22175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f413e89-2957-43c8-8186-f33fc531139d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a212b0-9f33-4bc9-884c-76c28a1a5100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Volume volume-7f413e89-2957-43c8-8186-f33fc531139d (7f413e89-2957-43c8-8186-f33fc531139d): created successfully Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a212b0-9f33-4bc9-884c-76c28a1a5100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (f302694c-c46a-494f-9311-947bab4e539f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:12 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-111ec84b-1d00-4baf-82e5-d9c0ca16a969 tempest-VolumesGetTest-2018382785 None] Created volume successfully. Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (52012f27-08ff-4d4b-9bac-d53c135bb48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63422d83-ad0a-4a7c-b3f0-7269d5819103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63422d83-ad0a-4a7c-b3f0-7269d5819103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-639987868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d225f1d-006d-419b-89c0-703831aaf73e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7f413e89-2957-43c8-8186-f33fc531139d,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:13Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b0b5fa-9ef4-4ece-9743-8de97c37fba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b0b5fa-9ef4-4ece-9743-8de97c37fba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3845ee12-6b85-435e-a02c-74f9df1d265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3845ee12-6b85-435e-a02c-74f9df1d265a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9d225f1d-006d-419b-89c0-703831aaf73e', 'volume_name': 'volume-9d225f1d-006d-419b-89c0-703831aaf73e', 'volume_size': 1, 'source_volid': '7f413e89-2957-43c8-8186-f33fc531139d', 'source_volstatus': 'available'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aca3edb-848d-4930-a823-60c82404f781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aca3edb-848d-4930-a823-60c82404f781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe935135-c6ec-4bcc-b759-d2050206b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Volume 9d225f1d-006d-419b-89c0-703831aaf73e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9d225f1d-006d-419b-89c0-703831aaf73e', 'volume_size': 1, 'source_volid': '7f413e89-2957-43c8-8186-f33fc531139d', 'source_volstatus': 'available'} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:12 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Cloning volume 7f413e89-2957-43c8-8186-f33fc531139d to volume 9d225f1d-006d-419b-89c0-703831aaf73e Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Creating offline snapshot ee94cad0-5759-4d20-a890-cf27a0474108 of volume 7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b1330e-f5f4-4d0b-897b-7c7dddcc32ae]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:13 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d Nov 01 09:49:13 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:13 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d" returned: 0 in 0.353s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:13 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 1G Nov 01 09:49:13 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:13 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 1G" returned: 0 in 0.406s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f413e89-2957-43c8-8186-f33fc531139d -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:13 devstack sudo[103270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f413e89-2957-43c8-8186-f33fc531139d -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 Nov 01 09:49:13 devstack sudo[103270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:13 devstack sudo[103270]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f413e89-2957-43c8-8186-f33fc531139d -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108" returned: 0 in 0.289s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:13 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 is being set with open permissions: ugo+rw Nov 01 09:49:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:13 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 Nov 01 09:49:13 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:14 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108" returned: 0 in 0.238s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:14 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.info Nov 01 09:49:14 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:14 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.info" returned: 0 in 0.247s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:14 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.info is being set with open permissions: ugo+rw Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:14 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.info Nov 01 09:49:14 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:14 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.info" returned: 0 in 0.249s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-9d225f1d-006d-419b-89c0-703831aaf73e" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-9d225f1d-006d-419b-89c0-703831aaf73e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] snapshot: ee94cad0-5759-4d20-a890-cf27a0474108, volume: 9d225f1d-006d-419b-89c0-703831aaf73e, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7df2c73-f5c3-42f8-9e2d-57d5419b387b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:14 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 Nov 01 09:49:14 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:15 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108" returned: 0 in 0.364s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f413e89-2957-43c8-8186-f33fc531139d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc25f76-bd57-4d7a-a3bc-9bf6a2726896]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:15 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d Nov 01 09:49:15 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:15 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d" returned: 0 in 0.372s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:49:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:15 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e Nov 01 09:49:15 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:21 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e" returned: 0 in 6.053s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:49:21 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Converted 1024.00 MB image at 169.13 MB/s Nov 01 09:49:21 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e is being set with open permissions: ugo+rw Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:21 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e Nov 01 09:49:21 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:21 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e" returned: 0 in 0.234s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-9d225f1d-006d-419b-89c0-703831aaf73e" released by "_copy_volume_from_snapshot" :: held 7.093s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=97,cinder:INSERT=44,cinder:UPDATE=129,cinder:DELETE=13 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-ee94cad0-5759-4d20-a890-cf27a0474108" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-ee94cad0-5759-4d20-a890-cf27a0474108" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Deleting offline snapshot ee94cad0-5759-4d20-a890-cf27a0474108 of volume 7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] snapshot_file for this snap is: volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acdd8d8-2b12-4d57-a0e5-c28e85f3dcae]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:22 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 Nov 01 09:49:22 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:22 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108" returned: 0 in 0.352s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f413e89-2957-43c8-8186-f33fc531139d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:49:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb02a35a-1c7a-4113-a292-e26361093367]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:22 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d Nov 01 09:49:22 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:22 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d" returned: 0 in 0.504s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:22 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 Nov 01 09:49:22 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:23 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108" returned: 0 in 0.323s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:23 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108 Nov 01 09:49:23 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:23 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d.ee94cad0-5759-4d20-a890-cf27a0474108" returned: 0 in 0.240s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-ee94cad0-5759-4d20-a890-cf27a0474108" released by "_delete_snapshot" :: held 1.518s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=102,cinder:INSERT=31,cinder:UPDATE=134,cinder:DELETE=10 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.578s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe935135-c6ec-4bcc-b759-d2050206b96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d225f1d-006d-419b-89c0-703831aaf73e', 'volume_size': 1, 'source_volid': '7f413e89-2957-43c8-8186-f33fc531139d', 'source_volstatus': 'available'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6856035-2c18-4a3b-93f2-53ebf9e56e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Volume volume-9d225f1d-006d-419b-89c0-703831aaf73e (9d225f1d-006d-419b-89c0-703831aaf73e): created successfully Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6856035-2c18-4a3b-93f2-53ebf9e56e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (52012f27-08ff-4d4b-9bac-d53c135bb48f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:23 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7f741753-de20-4be9-a861-59434316ca50 tempest-VolumesGetTest-2018382785 None] Created volume successfully. Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (05d459ec-5b78-4f67-8954-6f858780249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f86dfb-128f-4d65-ac84-57e9e61d85db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f86dfb-128f-4d65-ac84-57e9e61d85db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1354162021',display_name='tempest-VolumesGetTest-Volume-1305348613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:25Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5719f2e-c408-421e-b63d-c4d4e5f1cdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5719f2e-c408-421e-b63d-c4d4e5f1cdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb7c937-9f06-4d1d-8491-fe05b12f31a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb7c937-9f06-4d1d-8491-fe05b12f31a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d', 'volume_name': 'volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a39093e-2078-47ce-a8e9-02838f6e7e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a39093e-2078-47ce-a8e9-02838f6e7e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d314d05a-05ac-482a-bac0-f16f9fb4b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:25 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Volume fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d', 'volume_size': 1} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1354162021',display_name='tempest-VolumesGetTest-Volume-1305348613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:25Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Creating volume fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:49:25 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:25 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d 1073741824 Nov 01 09:49:25 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:25 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d 1073741824" returned: 0 in 0.424s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:25 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d Nov 01 09:49:25 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:25 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d314d05a-05ac-482a-bac0-f16f9fb4b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab605ec-2b99-4b15-ae21-5dd374fd3162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:25 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Volume volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d (fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d): created successfully Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab605ec-2b99-4b15-ae21-5dd374fd3162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (05d459ec-5b78-4f67-8954-6f858780249f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0425958a-7b1f-4ec6-8722-75686b3ed71b tempest-VolumesGetTest-2018382785 None] Created volume successfully. Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Lock "cinder-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf2f5b2-45a2-4aaa-97f0-157a42a6188c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:26 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d Nov 01 09:49:26 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:26 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d" returned: 0 in 0.355s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:26 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d Nov 01 09:49:26 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:26 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d" released by "delete_volume" :: held 0.636s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Created reservations ['b96cee9b-f380-4871-b3e8-c837353fafd7', '334172aa-7e21-4f7f-b66c-4dc9e9dc3975', '16f47a7d-738f-44b7-89c2-acf57d26de38', 'e55812bd-8deb-428f-93f9-ac8899ab1571'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:27 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:49:27 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:27 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:49:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Deleted volume successfully. Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5e9ee695-0539-4156-b931-459cd20dd635 tempest-VolumesGetTest-2018382785 None] Lock "cinder-fa4b7ee5-7ae8-4d38-9bf3-c76c49e7f65d-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-9d225f1d-006d-419b-89c0-703831aaf73e-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Lock "cinder-9d225f1d-006d-419b-89c0-703831aaf73e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-9d225f1d-006d-419b-89c0-703831aaf73e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-9d225f1d-006d-419b-89c0-703831aaf73e" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fe39f5-437a-4e44-9e02-f9adfe20899a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:27 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e Nov 01 09:49:27 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:27 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e" returned: 0 in 0.347s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:27 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e Nov 01 09:49:27 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:28 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d225f1d-006d-419b-89c0-703831aaf73e" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-9d225f1d-006d-419b-89c0-703831aaf73e" released by "delete_volume" :: held 0.629s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Created reservations ['d154c67c-908b-4569-9d04-39d865f9ba52', 'e04df001-f5bc-46b5-8e50-72afb109f251', '34495960-4487-4184-9e71-9dfaabd1f1a7', '841bea14-ba33-455e-9714-e94e7dda90e7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:28 devstack sudo[103359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:49:28 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:28 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:49:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Deleted volume successfully. Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e81a1eb5-1506-4eae-a6eb-9b946c4bdc41 tempest-VolumesGetTest-2018382785 None] Lock "cinder-9d225f1d-006d-419b-89c0-703831aaf73e-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-7f413e89-2957-43c8-8186-f33fc531139d-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Lock "cinder-7f413e89-2957-43c8-8186-f33fc531139d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-7f413e89-2957-43c8-8186-f33fc531139d" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-7f413e89-2957-43c8-8186-f33fc531139d" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc5ceef-9759-4d8b-96dc-383fc9064212]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:28 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d Nov 01 09:49:28 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:29 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d" returned: 0 in 0.353s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:29 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d Nov 01 09:49:29 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:29 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7f413e89-2957-43c8-8186-f33fc531139d" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-7f413e89-2957-43c8-8186-f33fc531139d" released by "delete_volume" :: held 0.659s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Created reservations ['d36580d3-271c-4b9a-aabb-2c6c58b859dc', 'f0cf6672-5ac7-4aea-bbb2-c5ebbcb9886c', '02f91641-f43f-4bdf-9736-64439427e416', '4bba854b-0c34-49dd-9986-53974fac86ab'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:29 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:49:29 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:29 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:49:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Deleted volume successfully. Nov 01 09:49:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b512b7b-d33b-41bb-89c1-9c44cf743e80 tempest-VolumesGetTest-2018382785 None] Lock "cinder-7f413e89-2957-43c8-8186-f33fc531139d-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (ba8cdac2-2f54-4e09-bac0-72e8d7c07a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4dbf3a-04c4-4bb9-83c0-40f92f77934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4dbf3a-04c4-4bb9-83c0-40f92f77934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1969007653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d003398-baf2-4107-b5a6-fe35c7fa859f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:31Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626c5fa6-919f-4e33-ae9b-e9c25fdd7ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626c5fa6-919f-4e33-ae9b-e9c25fdd7ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd208c5-e259-4e84-9c18-4bb92afa4426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd208c5-e259-4e84-9c18-4bb92afa4426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d003398-baf2-4107-b5a6-fe35c7fa859f', 'volume_name': 'volume-9d003398-baf2-4107-b5a6-fe35c7fa859f', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4735ea-da87-4432-8f86-67a51a0e73e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b4735ea-da87-4432-8f86-67a51a0e73e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678d2f02-6d65-4bae-b7f0-f1e215a1fc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Volume 9d003398-baf2-4107-b5a6-fe35c7fa859f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d003398-baf2-4107-b5a6-fe35c7fa859f', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 09:49:30 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Trying to clone 9d003398-baf2-4107-b5a6-fe35c7fa859f from image c507ec59-c87f-4d5c-be6c-eab60d7c916d at location (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:49:31 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:49:31 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Image download 20.69 MB at 20.69 MB/s Nov 01 09:49:31 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e7a526-7c62-4fe1-bd25-95406c27db13]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:31 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD Nov 01 09:49:31 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:31 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD" returned: 0 in 0.330s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:31 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d is fetched for user 88022be9ef7d4c4d9516ae2b27f1ce4e. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:49:31 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d191c7b-3a4a-4589-9c8e-18cd4e7a2e85]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:31 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD Nov 01 09:49:31 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:32 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1969007653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d003398-baf2-4107-b5a6-fe35c7fa859f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:31Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Creating volume 9d003398-baf2-4107-b5a6-fe35c7fa859f {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:49:32 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:32 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f 1073741824 Nov 01 09:49:32 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:32 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f 1073741824" returned: 0 in 0.401s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:32 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f Nov 01 09:49:32 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:32 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Attempting download of c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 9d003398-baf2-4107-b5a6-fe35c7fa859f. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9441901b-a134-4b52-8b7e-a9059c824eac]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_htzfz7g1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:32 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_htzfz7g1 Nov 01 09:49:32 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:33 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_htzfz7g1" returned: 0 in 0.314s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_htzfz7g1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:33 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_htzfz7g1 Nov 01 09:49:33 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:33 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_htzfz7g1" returned: 1 in 0.314s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c507ec59-c87f-4d5c-be6c-eab60d7c916d_htzfz7g1' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4d050f-4dae-4b9a-a0af-531a8655dc8c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:33 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD Nov 01 09:49:33 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:33 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] c507ec59-c87f-4d5c-be6c-eab60d7c916d was qcow2, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:49:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:33 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f Nov 01 09:49:33 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:35 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f" returned: 0 in 1.698s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c507ec59-c87f-4d5c-be6c-eab60d7c916d__2eqnuubdevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:49:35 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Converted 112.00 MB image at 65.92 MB/s Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:35 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f 1G Nov 01 09:49:35 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:35 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f 1G" returned: 0 in 0.313s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Downloaded image c507ec59-c87f-4d5c-be6c-eab60d7c916d ((None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}])) to volume 9d003398-baf2-4107-b5a6-fe35c7fa859f successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Temporary image c507ec59-c87f-4d5c-be6c-eab60d7c916d for user 88022be9ef7d4c4d9516ae2b27f1ce4e is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Marking volume 9d003398-baf2-4107-b5a6-fe35c7fa859f as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Copying metadata from image c507ec59-c87f-4d5c-be6c-eab60d7c916d to 9d003398-baf2-4107-b5a6-fe35c7fa859f. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Creating volume glance metadata for volume 9d003398-baf2-4107-b5a6-fe35c7fa859f backed by image c507ec59-c87f-4d5c-be6c-eab60d7c916d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678d2f02-6d65-4bae-b7f0-f1e215a1fc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d003398-baf2-4107-b5a6-fe35c7fa859f', 'volume_size': 1, 'image_id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c80d97c671bf4f548ea93567e3fbe23d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c507ec59-c87f-4d5c-be6c-eab60d7c916d', 'created_at': datetime.datetime(2026, 11, 1, 8, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c507ec59-c87f-4d5c-be6c-eab60d7c916d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800eaf20-450d-4c23-b8c0-ad452342763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:35 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Volume volume-9d003398-baf2-4107-b5a6-fe35c7fa859f (9d003398-baf2-4107-b5a6-fe35c7fa859f): created successfully Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800eaf20-450d-4c23-b8c0-ad452342763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (ba8cdac2-2f54-4e09-bac0-72e8d7c07a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-16f910f1-4b1c-443d-a9a9-c8e3956ca146 tempest-VolumesGetTest-2018382785 None] Created volume successfully. Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (75ae69cb-f2c5-41dd-93e7-d4d1b25cba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3e3bc3-398a-4dec-9731-a88ec267e3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3e3bc3-398a-4dec-9731-a88ec267e3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1517127054',display_name='tempest-VolumesGetTest-Volume-978550466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adeb853-cb10-4e8f-ba37-77646e168908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:37Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d081f4a6-c7c5-4afb-a6b0-af8bfe4bb510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d081f4a6-c7c5-4afb-a6b0-af8bfe4bb510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca276c8d-b441-4aec-81b5-2c13e18e0e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca276c8d-b441-4aec-81b5-2c13e18e0e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3adeb853-cb10-4e8f-ba37-77646e168908', 'volume_name': 'volume-3adeb853-cb10-4e8f-ba37-77646e168908', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89aea63e-fce2-42d6-9eca-09d44472c1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89aea63e-fce2-42d6-9eca-09d44472c1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bd6ed9-e35b-4a88-9c80-bc0ae0082017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:37 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Volume 3adeb853-cb10-4e8f-ba37-77646e168908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3adeb853-cb10-4e8f-ba37-77646e168908', 'volume_size': 1} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:49:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1517127054',display_name='tempest-VolumesGetTest-Volume-978550466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adeb853-cb10-4e8f-ba37-77646e168908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fc65b3449245c691579a0113b63286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:49:37Z,use_quota=True,user_id='88022be9ef7d4c4d9516ae2b27f1ce4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Creating volume 3adeb853-cb10-4e8f-ba37-77646e168908 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:49:37 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:49:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:37 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 1073741824 Nov 01 09:49:37 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:38 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 1073741824" returned: 0 in 0.415s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:38 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 Nov 01 09:49:38 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:38 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908" returned: 0 in 0.254s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bd6ed9-e35b-4a88-9c80-bc0ae0082017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3adeb853-cb10-4e8f-ba37-77646e168908', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1be474-bdb0-4e69-a452-c282ca9c085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:49:38 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Volume volume-3adeb853-cb10-4e8f-ba37-77646e168908 (3adeb853-cb10-4e8f-ba37-77646e168908): created successfully Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1be474-bdb0-4e69-a452-c282ca9c085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Flow 'volume_create_manager' (75ae69cb-f2c5-41dd-93e7-d4d1b25cba40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:49:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4207efc3-5e7e-4574-a332-fc09abf7fbe3 tempest-VolumesGetTest-2018382785 None] Created volume successfully. Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-3adeb853-cb10-4e8f-ba37-77646e168908-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Lock "cinder-3adeb853-cb10-4e8f-ba37-77646e168908-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-3adeb853-cb10-4e8f-ba37-77646e168908" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-3adeb853-cb10-4e8f-ba37-77646e168908" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf120ada-0a28-4668-aad8-92c2d2bf3c73]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:38 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 Nov 01 09:49:38 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:39 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908" returned: 0 in 0.348s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:39 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908 Nov 01 09:49:39 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:39 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3adeb853-cb10-4e8f-ba37-77646e168908" returned: 0 in 0.245s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-3adeb853-cb10-4e8f-ba37-77646e168908" released by "delete_volume" :: held 0.633s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Created reservations ['6010c4c7-517c-42d4-8434-a78db39cae0d', '2a4c3894-2ca4-4a28-9097-c6db8b5af2bc', '0ef7ba65-c11d-4c9c-960e-aebf813ab90c', '9e8a7360-6679-48f7-96ab-14c6a578c334'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:39 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:49:39 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:39 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.254s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:49:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Deleted volume successfully. Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d3f32572-e4a6-4d1f-806d-d3d8d68e8936 tempest-VolumesGetTest-2018382785 None] Lock "cinder-3adeb853-cb10-4e8f-ba37-77646e168908-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-9d003398-baf2-4107-b5a6-fe35c7fa859f-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Lock "cinder-9d003398-baf2-4107-b5a6-fe35c7fa859f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Acquiring lock "cinder-quobyte-9d003398-baf2-4107-b5a6-fe35c7fa859f" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-9d003398-baf2-4107-b5a6-fe35c7fa859f" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b18f48-5244-4229-afb9-5c98694a8b95]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:49:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:40 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f Nov 01 09:49:40 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:40 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f" returned: 0 in 0.354s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:40 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f Nov 01 09:49:40 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:40 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9d003398-baf2-4107-b5a6-fe35c7fa859f" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Lock "cinder-quobyte-9d003398-baf2-4107-b5a6-fe35c7fa859f" released by "delete_volume" :: held 0.637s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Created reservations ['bda20759-7608-4399-a4e1-7c2ff8e44f88', 'aadeaa3c-a9f9-45a6-bab3-ea11fa3aef0b', '4e9ee29b-dd80-45bc-9e0e-14053367f8b7', '8363ea1f-0f48-4b67-8f41-e89fee3e66c4'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:40 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:49:40 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:40 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.258s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:49:40 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Deleted volume successfully. Nov 01 09:49:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b45a526-10bf-4975-885b-2b9212dcabdd tempest-VolumesGetTest-2018382785 None] Lock "cinder-9d003398-baf2-4107-b5a6-fe35c7fa859f-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:49:50 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=53,cinder:SELECT=41,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:49:50 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=53,cinder:SELECT=38,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:49:53 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:49:53 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:49:53 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:49:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Flow 'volume_create_manager' (b45e8d25-3afa-4a76-b01d-bbd19ff33b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77f4f85-c69b-483f-875c-0448f3f2d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77f4f85-c69b-483f-875c-0448f3f2d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-916700224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d780910-cc09-428b-8ea0-8eaf42cd32df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9568ae0b61ea47289a130e6b6d56865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:50:04Z,use_quota=True,user_id='831195e688b4436a922164a1e1af8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3170a39-1a8c-4f60-850b-a459ea1556cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3170a39-1a8c-4f60-850b-a459ea1556cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b86915-ecac-4ea4-88a0-1dc71f896bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b86915-ecac-4ea4-88a0-1dc71f896bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d780910-cc09-428b-8ea0-8eaf42cd32df', 'volume_name': 'volume-3d780910-cc09-428b-8ea0-8eaf42cd32df', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890d3194-1bf4-4bb8-b9bc-cf015db43444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (890d3194-1bf4-4bb8-b9bc-cf015db43444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cca00b-b249-4b1d-bef5-949d869cfea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:50:03 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Volume 3d780910-cc09-428b-8ea0-8eaf42cd32df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d780910-cc09-428b-8ea0-8eaf42cd32df', 'volume_size': 1} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-916700224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d780910-cc09-428b-8ea0-8eaf42cd32df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9568ae0b61ea47289a130e6b6d56865e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:50:04Z,use_quota=True,user_id='831195e688b4436a922164a1e1af8e8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Creating volume 3d780910-cc09-428b-8ea0-8eaf42cd32df {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:50:03 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:50:04 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:04 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df 1073741824 Nov 01 09:50:04 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:04 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df 1073741824" returned: 0 in 0.403s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:04 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df Nov 01 09:50:04 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:04 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96cca00b-b249-4b1d-bef5-949d869cfea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d780910-cc09-428b-8ea0-8eaf42cd32df', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c144bb5-a449-498b-83bd-21dc16b9fb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:50:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Volume volume-3d780910-cc09-428b-8ea0-8eaf42cd32df (3d780910-cc09-428b-8ea0-8eaf42cd32df): created successfully Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c144bb5-a449-498b-83bd-21dc16b9fb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:50:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Flow 'volume_create_manager' (b45e8d25-3afa-4a76-b01d-bbd19ff33b82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:50:04 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-db5b503b-b974-4fc4-97be-ee05b9ed65d6 tempest-TestImageHashVerification-1164645784 None] Created volume successfully. Nov 01 09:50:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:50:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:50:05 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cdeec6-752a-4fd7-a732-fb5aaa7f39e5]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:50:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:05 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df Nov 01 09:50:05 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:06 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:06 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec50f7c7-a0f9-474d-9ff4-6cbbdcdfca77]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:50:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:06 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df Nov 01 09:50:06 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:06 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df" returned: 0 in 0.351s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df /opt/stack/data/cinder/conversion/3d780910-cc09-428b-8ea0-8eaf42cd32df.temp_image.0cc0667d-1214-4b74-84bc-c07fadd3028dg41zchvf.img {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:06 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df /opt/stack/data/cinder/conversion/3d780910-cc09-428b-8ea0-8eaf42cd32df.temp_image.0cc0667d-1214-4b74-84bc-c07fadd3028dg41zchvf.img Nov 01 09:50:06 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:12 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df /opt/stack/data/cinder/conversion/3d780910-cc09-428b-8ea0-8eaf42cd32df.temp_image.0cc0667d-1214-4b74-84bc-c07fadd3028dg41zchvf.img" returned: 0 in 5.722s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:12 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[39722531-842c-4729-87ea-7169bef02876]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:50:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:12 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df Nov 01 09:50:12 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:12 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df" returned: 0 in 0.520s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:12 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df, size 1024.00 MB, duration 5.72 sec, destination /opt/stack/data/cinder/conversion/3d780910-cc09-428b-8ea0-8eaf42cd32df.temp_image.0cc0667d-1214-4b74-84bc-c07fadd3028dg41zchvf.img {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:50:12 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Converted 1024.00 MB image at 178.91 MB/s Nov 01 09:50:12 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] 0cc0667d-1214-4b74-84bc-c07fadd3028d was raw, no need to convert to raw {{(pid=86594) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 01 09:50:22 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:50:22 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:50:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.202s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:50:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Uploaded volume to glance image-id: 0cc0667d-1214-4b74-84bc-c07fadd3028d. {{(pid=86594) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 09:50:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a8f19ffc-f094-41f5-8e94-b18606b44f61 tempest-TestImageHashVerification-1164645784 None] Copy volume to image completed successfully. Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Acquiring lock "cinder-3d780910-cc09-428b-8ea0-8eaf42cd32df-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Lock "cinder-3d780910-cc09-428b-8ea0-8eaf42cd32df-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Acquiring lock "cinder-quobyte-3d780910-cc09-428b-8ea0-8eaf42cd32df" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Lock "cinder-quobyte-3d780910-cc09-428b-8ea0-8eaf42cd32df" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0dcc04-f5de-4f24-a50f-3c820ce5089b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:32 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df Nov 01 09:50:32 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:32 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:32 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df Nov 01 09:50:32 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:32 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3d780910-cc09-428b-8ea0-8eaf42cd32df" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Lock "cinder-quobyte-3d780910-cc09-428b-8ea0-8eaf42cd32df" released by "delete_volume" :: held 0.646s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Created reservations ['7234d92f-d5f3-452b-8a4f-e911ca7f7cd0', 'c9ddf4cf-ce00-46e0-9663-58ad4a1fd666', 'e014176a-2674-4a65-8cf2-b04b4e11ff90', 'dd4e2ff3-41f3-4744-9645-0e0f9bd5cae1'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:50:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:32 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:50:32 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:33 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.243s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:33 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:50:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Deleted volume successfully. Nov 01 09:50:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bd661492-35ed-457c-b1a5-463196763c6a tempest-TestImageHashVerification-1164645784 None] Lock "cinder-3d780910-cc09-428b-8ea0-8eaf42cd32df-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:50:42 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:50:43 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:50:53 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:50:53 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:50:53 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.266s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:50:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:51:03 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:51:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Flow 'volume_create_manager' (18b2c69d-9ba6-43f2-8ea0-435cbce96bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:51:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e17743d-8f82-4cfb-8d6a-495cdac28e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e17743d-8f82-4cfb-8d6a-495cdac28e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-674295628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d693378d-0a03-4914-afde-1663be50f700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dafb891859342da90a18b151492435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:51:04Z,use_quota=True,user_id='2c3a891724a1475ab53cef6c0855b7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41af0d8c-4495-41a6-9fb6-38af50c71c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41af0d8c-4495-41a6-9fb6-38af50c71c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a023e624-b018-4c41-8c06-240e0bb08ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a023e624-b018-4c41-8c06-240e0bb08ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd693378d-0a03-4914-afde-1663be50f700', 'volume_name': 'volume-d693378d-0a03-4914-afde-1663be50f700', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9503810-8b06-4be1-a0df-46e89dffd1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9503810-8b06-4be1-a0df-46e89dffd1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d3e7a4-5a56-465e-b456-9558b7a47444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Volume d693378d-0a03-4914-afde-1663be50f700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d693378d-0a03-4914-afde-1663be50f700', 'volume_size': 1} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-674295628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d693378d-0a03-4914-afde-1663be50f700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dafb891859342da90a18b151492435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:51:04Z,use_quota=True,user_id='2c3a891724a1475ab53cef6c0855b7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Creating volume d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:51:04 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:04 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 1073741824 Nov 01 09:51:04 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:04 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 1073741824" returned: 0 in 0.459s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:04 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 Nov 01 09:51:04 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:04 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700" returned: 0 in 0.286s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d3e7a4-5a56-465e-b456-9558b7a47444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d693378d-0a03-4914-afde-1663be50f700', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0d17ac-ebed-480d-9227-46503dbc0185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Volume volume-d693378d-0a03-4914-afde-1663be50f700 (d693378d-0a03-4914-afde-1663be50f700): created successfully Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0d17ac-ebed-480d-9227-46503dbc0185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Flow 'volume_create_manager' (18b2c69d-9ba6-43f2-8ea0-435cbce96bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:51:04 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5217e0aa-85a4-4480-897a-fa5415fa22ca tempest-TestStampPattern-1356281698 None] Created volume successfully. Nov 01 09:51:14 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:51:14 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:51:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-29fbec54-8b1e-4bdb-bf73-d0bad19a215c req-b151850c-ad0f-427d-9e5c-dcac46f5da1f tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:51:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-29fbec54-8b1e-4bdb-bf73-d0bad19a215c req-b151850c-ad0f-427d-9e5c-dcac46f5da1f tempest-TestStampPattern-1356281698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:51:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-29fbec54-8b1e-4bdb-bf73-d0bad19a215c req-b151850c-ad0f-427d-9e5c-dcac46f5da1f tempest-TestStampPattern-1356281698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:51:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-29fbec54-8b1e-4bdb-bf73-d0bad19a215c req-b151850c-ad0f-427d-9e5c-dcac46f5da1f tempest-TestStampPattern-1356281698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-d693378d-0a03-4914-afde-1663be50f700', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94706c1e-578a-49c9-8bf7-b4d235b4cade', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:51:34 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-29fbec54-8b1e-4bdb-bf73-d0bad19a215c req-b151850c-ad0f-427d-9e5c-dcac46f5da1f tempest-TestStampPattern-1356281698 None] attachment_update completed successfully. Nov 01 09:51:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-565f4285-227d-4db1-9595-8dfc43078360 req-47186f0c-df0a-4c4e-815e-6b45bc47a29a tempest-TestStampPattern-1356281698 None] Terminate volume connection completed successfully. Nov 01 09:51:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-565f4285-227d-4db1-9595-8dfc43078360 req-47186f0c-df0a-4c4e-815e-6b45bc47a29a tempest-TestStampPattern-1356281698 None] Deleting attachment 94706c1e-578a-49c9-8bf7-b4d235b4cade. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Creating offline snapshot 9a344bce-e57d-487e-966b-cdb4dcc79490 of volume d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[489630e9-49a1-40b7-9ebf-1f112afba55c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:39 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 Nov 01 09:51:39 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:39 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700" returned: 0 in 0.364s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:39 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 1G Nov 01 09:51:39 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:39 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 1G" returned: 0 in 0.394s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d693378d-0a03-4914-afde-1663be50f700 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:39 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d693378d-0a03-4914-afde-1663be50f700 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 Nov 01 09:51:39 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:40 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d693378d-0a03-4914-afde-1663be50f700 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490" returned: 0 in 0.283s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:40 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 is being set with open permissions: ugo+rw Nov 01 09:51:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:40 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 Nov 01 09:51:40 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:40 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490" returned: 0 in 0.244s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:40 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.info Nov 01 09:51:40 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:40 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.info" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:40 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.info is being set with open permissions: ugo+rw Nov 01 09:51:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:40 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.info Nov 01 09:51:40 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:41 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.info" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:51:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a8443c62-1be3-453d-82b9-d19f95b69fe1 tempest-TestStampPattern-1356281698 None] Create snapshot completed successfully Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Flow 'volume_create_manager' (03e964e1-f0e5-4b27-97d8-13c6409955ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062d0fef-ba9a-491d-a0fb-efc4abc7413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062d0fef-ba9a-491d-a0fb-efc4abc7413a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1801912282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb8389c-ab24-4304-9e97-c666f8360df4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dafb891859342da90a18b151492435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9a344bce-e57d-487e-966b-cdb4dcc79490,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:51:48Z,use_quota=True,user_id='2c3a891724a1475ab53cef6c0855b7cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7876d7-bc0b-4577-91b5-da551c35bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7876d7-bc0b-4577-91b5-da551c35bf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9a60ac-8b62-4607-95dc-a535ff641fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae9a60ac-8b62-4607-95dc-a535ff641fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4fb8389c-ab24-4304-9e97-c666f8360df4', 'volume_name': 'volume-4fb8389c-ab24-4304-9e97-c666f8360df4', 'volume_size': 1, 'snapshot_id': '9a344bce-e57d-487e-966b-cdb4dcc79490'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4b2115-2815-46b2-94d8-823e0a96967b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4b2115-2815-46b2-94d8-823e0a96967b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f988b3-55d5-496b-9a98-e7637a8e402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:47 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Volume 4fb8389c-ab24-4304-9e97-c666f8360df4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4fb8389c-ab24-4304-9e97-c666f8360df4', 'volume_size': 1, 'snapshot_id': '9a344bce-e57d-487e-966b-cdb4dcc79490'} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-quobyte-9a344bce-e57d-487e-966b-cdb4dcc79490-4fb8389c-ab24-4304-9e97-c666f8360df4" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-9a344bce-e57d-487e-966b-cdb4dcc79490-4fb8389c-ab24-4304-9e97-c666f8360df4" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Creating volume 4fb8389c-ab24-4304-9e97-c666f8360df4 from snapshot 9a344bce-e57d-487e-966b-cdb4dcc79490 {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-quobyte-4fb8389c-ab24-4304-9e97-c666f8360df4" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-4fb8389c-ab24-4304-9e97-c666f8360df4" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] snapshot: 9a344bce-e57d-487e-966b-cdb4dcc79490, volume: 4fb8389c-ab24-4304-9e97-c666f8360df4, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:51:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bbbee0-ab1f-4aa6-abd8-aadad62d493e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:48 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 Nov 01 09:51:48 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:48 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490" returned: 0 in 0.395s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d693378d-0a03-4914-afde-1663be50f700(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6caf3c-70f3-4c5b-a96b-f1036ad3757c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:48 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 Nov 01 09:51:48 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:48 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700" returned: 0 in 0.418s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:51:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:48 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 Nov 01 09:51:48 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:53 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:51:53 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:53 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.473s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:51:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:51:57 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4" returned: 0 in 8.860s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:57 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700, size 1024.00 MB, duration 8.86 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:51:57 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Converted 1024.00 MB image at 115.56 MB/s Nov 01 09:51:57 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 is being set with open permissions: ugo+rw Nov 01 09:51:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:51:57 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 Nov 01 09:51:57 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:51:57 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=15,cinder:UPDATE=3 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:51:57 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:51:57 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Nov 01 09:51:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4" returned: 0 in 0.258s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:51:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-4fb8389c-ab24-4304-9e97-c666f8360df4" released by "_copy_volume_from_snapshot" :: held 10.032s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:51:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-9a344bce-e57d-487e-966b-cdb4dcc79490-4fb8389c-ab24-4304-9e97-c666f8360df4" released by "_create_volume_from_snapshot" :: held 10.102s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:51:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.118s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:51:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f988b3-55d5-496b-9a98-e7637a8e402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb8389c-ab24-4304-9e97-c666f8360df4', 'volume_size': 1, 'snapshot_id': '9a344bce-e57d-487e-966b-cdb4dcc79490'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a012c6-6b7c-4ef5-ad17-4f1475b4dde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:51:58 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Volume volume-4fb8389c-ab24-4304-9e97-c666f8360df4 (4fb8389c-ab24-4304-9e97-c666f8360df4): created successfully Nov 01 09:51:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a012c6-6b7c-4ef5-ad17-4f1475b4dde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:51:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Flow 'volume_create_manager' (03e964e1-f0e5-4b27-97d8-13c6409955ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:51:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d2e2780f-04ff-4680-93c9-55d1bedc481a tempest-TestStampPattern-1356281698 None] Created volume successfully. Nov 01 09:52:08 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:52:08 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:52:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-d2697504-44cc-46c0-90c3-3cc054f57bab req-9dc4909d-3f00-4bc7-afd3-40457d7bb7d8 tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:52:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-d2697504-44cc-46c0-90c3-3cc054f57bab req-9dc4909d-3f00-4bc7-afd3-40457d7bb7d8 tempest-TestStampPattern-1356281698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:52:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [req-d2697504-44cc-46c0-90c3-3cc054f57bab req-9dc4909d-3f00-4bc7-afd3-40457d7bb7d8 tempest-TestStampPattern-1356281698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:52:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-d2697504-44cc-46c0-90c3-3cc054f57bab req-9dc4909d-3f00-4bc7-afd3-40457d7bb7d8 tempest-TestStampPattern-1356281698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642', 'name': 'volume-4fb8389c-ab24-4304-9e97-c666f8360df4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c3cb46b-5de8-4345-b181-229855b3d998', 'enforce_multipath': True} {{(pid=86594) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 09:52:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-d2697504-44cc-46c0-90c3-3cc054f57bab req-9dc4909d-3f00-4bc7-afd3-40457d7bb7d8 tempest-TestStampPattern-1356281698 None] attachment_update completed successfully. Nov 01 09:52:40 devstack cinder-volume[86594]: INFO cinder.volume.manager [req-9aad3eff-b253-4751-bcd6-ffff6e71ed1c req-2fe16ab3-e32c-43c0-a9cd-1b071e866f9a tempest-TestStampPattern-1356281698 None] Terminate volume connection completed successfully. Nov 01 09:52:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [req-9aad3eff-b253-4751-bcd6-ffff6e71ed1c req-2fe16ab3-e32c-43c0-a9cd-1b071e866f9a tempest-TestStampPattern-1356281698 None] Deleting attachment 7c3cb46b-5de8-4345-b181-229855b3d998. {{(pid=86594) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-4fb8389c-ab24-4304-9e97-c666f8360df4-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Lock "cinder-4fb8389c-ab24-4304-9e97-c666f8360df4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-quobyte-4fb8389c-ab24-4304-9e97-c666f8360df4" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-4fb8389c-ab24-4304-9e97-c666f8360df4" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[705956fe-0bdb-47b7-a607-5f358a36cbac]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:45 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 Nov 01 09:52:45 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:45 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4" returned: 0 in 0.380s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:45 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4 Nov 01 09:52:45 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:45 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4fb8389c-ab24-4304-9e97-c666f8360df4" returned: 0 in 0.260s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-4fb8389c-ab24-4304-9e97-c666f8360df4" released by "delete_volume" :: held 0.684s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Created reservations ['3a0dc002-8cdd-4f82-8c2e-c57365e00989', '02195999-a5b3-4027-be3b-ee888a9644e1', '04ef4d2a-9818-473a-9313-7982cdf1ef08', '71840aee-bb6e-4ee3-afef-d9b198456842'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:52:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:45 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:52:45 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:46 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.255s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:52:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Deleted volume successfully. Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ba57b560-5c7a-4c34-a151-cbfa5468d745 tempest-TestStampPattern-1356281698 None] Lock "cinder-4fb8389c-ab24-4304-9e97-c666f8360df4-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-9a344bce-e57d-487e-966b-cdb4dcc79490-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Lock "cinder-9a344bce-e57d-487e-966b-cdb4dcc79490-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-quobyte-d693378d-0a03-4914-afde-1663be50f700" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-d693378d-0a03-4914-afde-1663be50f700" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-quobyte-9a344bce-e57d-487e-966b-cdb4dcc79490" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-9a344bce-e57d-487e-966b-cdb4dcc79490" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Deleting offline snapshot 9a344bce-e57d-487e-966b-cdb4dcc79490 of volume d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] snapshot_file for this snap is: volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dfc1a1-bd24-44f7-8b82-14bfa699f975]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:46 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 Nov 01 09:52:46 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:46 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490" returned: 0 in 0.370s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d693378d-0a03-4914-afde-1663be50f700(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c954d04f-88b0-47e3-a153-a1d2d1c83cd0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:52:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:47 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 Nov 01 09:52:47 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:47 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700" returned: 0 in 0.509s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:47 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 Nov 01 09:52:47 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:47 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:47 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490 Nov 01 09:52:47 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:48 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700.9a344bce-e57d-487e-966b-cdb4dcc79490" returned: 0 in 0.251s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-9a344bce-e57d-487e-966b-cdb4dcc79490" released by "_delete_snapshot" :: held 1.554s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:52:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-d693378d-0a03-4914-afde-1663be50f700" released by "delete_snapshot" :: held 1.580s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:52:48 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Created reservations ['e504e1d3-2c95-4ee3-aa94-b2b7fc476019', '472a0bce-b293-420b-84a4-5d3058a57a97', '18625051-4282-4f12-8994-31e1a6fd5989', '1828917f-6d66-47e5-befd-4c05746f2b54'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:52:48 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Delete snapshot completed successfully. Nov 01 09:52:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fbc4699e-8718-4982-996c-b724a7e01b84 tempest-TestStampPattern-1356281698 None] Lock "cinder-9a344bce-e57d-487e-966b-cdb4dcc79490-delete_snapshot" released by "delete_snapshot" :: held 1.714s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:52:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-d693378d-0a03-4914-afde-1663be50f700-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Lock "cinder-d693378d-0a03-4914-afde-1663be50f700-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Acquiring lock "cinder-quobyte-d693378d-0a03-4914-afde-1663be50f700" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-d693378d-0a03-4914-afde-1663be50f700" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac5b194-a902-4e42-beee-c8e7de49343b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:52 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 Nov 01 09:52:52 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:52 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700" returned: 0 in 0.346s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:52 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700 Nov 01 09:52:52 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:52 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d693378d-0a03-4914-afde-1663be50f700" returned: 0 in 0.237s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Lock "cinder-quobyte-d693378d-0a03-4914-afde-1663be50f700" released by "delete_volume" :: held 0.641s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Created reservations ['7eae315f-ff35-4587-a338-e0d15fa4b4c1', '62f0ee00-4789-480e-8f39-36f1bac28127', '809f39f6-f09d-4aa0-b811-788635b29ebc', '638f7d90-4bec-42e5-b52e-2ad6af341910'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:52:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:52 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:52:52 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:53 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.251s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:52:53 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Deleted volume successfully. Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e1e2d08b-0fb2-48f5-84b8-05a0be27451b tempest-TestStampPattern-1356281698 None] Lock "cinder-d693378d-0a03-4914-afde-1663be50f700-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:52:53 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:52:53 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:52:53 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.290s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:52:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:53:02 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=26,cinder:SELECT=18,cinder:INSERT=7 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:53:03 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=29,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (5f6da43f-b3da-405a-9c35-722cbdda487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519f0a47-effb-4d7e-a257-7d3175cc7eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519f0a47-effb-4d7e-a257-7d3175cc7eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1632854763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23da44b0-a020-4063-a087-2cb5ab051aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:04Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d339f12-6747-4660-95ba-574ccc1bba5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d339f12-6747-4660-95ba-574ccc1bba5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2efc0ca-ab60-4fb3-b194-f9b39b8da7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2efc0ca-ab60-4fb3-b194-f9b39b8da7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23da44b0-a020-4063-a087-2cb5ab051aaa', 'volume_name': 'volume-23da44b0-a020-4063-a087-2cb5ab051aaa', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441da982-0965-472c-b527-090b7e0e1487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441da982-0965-472c-b527-090b7e0e1487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f790bd-33de-496f-875b-2d7f752b3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume 23da44b0-a020-4063-a087-2cb5ab051aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23da44b0-a020-4063-a087-2cb5ab051aaa', 'volume_size': 1} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1632854763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23da44b0-a020-4063-a087-2cb5ab051aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:04Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Creating volume 23da44b0-a020-4063-a087-2cb5ab051aaa {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:04 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:04 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa 1073741824 Nov 01 09:53:04 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:04 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa 1073741824" returned: 0 in 0.399s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:05 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa Nov 01 09:53:05 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:05 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa" returned: 0 in 0.240s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f790bd-33de-496f-875b-2d7f752b3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23da44b0-a020-4063-a087-2cb5ab051aaa', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6833a4-ad8e-4498-be96-8c1bbef85e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:05 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume volume-23da44b0-a020-4063-a087-2cb5ab051aaa (23da44b0-a020-4063-a087-2cb5ab051aaa): created successfully Nov 01 09:53:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6833a4-ad8e-4498-be96-8c1bbef85e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (5f6da43f-b3da-405a-9c35-722cbdda487b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:05 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1bc73135-fe9b-4753-9762-3bb57a60af40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created volume successfully. Nov 01 09:53:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Creating offline snapshot bf8e5079-6a0e-486d-ba5c-09f3809551c3 of volume 23da44b0-a020-4063-a087-2cb5ab051aaa {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:53:06 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1e6d98-1ed3-4816-8558-b32a4daa33ab]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:06 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa Nov 01 09:53:06 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:06 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:07 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 1G Nov 01 09:53:07 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:07 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 1G" returned: 0 in 0.371s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23da44b0-a020-4063-a087-2cb5ab051aaa -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:07 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23da44b0-a020-4063-a087-2cb5ab051aaa -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 Nov 01 09:53:07 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:07 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23da44b0-a020-4063-a087-2cb5ab051aaa -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:07 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 is being set with open permissions: ugo+rw Nov 01 09:53:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:07 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 Nov 01 09:53:07 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:07 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3" returned: 0 in 0.247s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:07 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.info Nov 01 09:53:07 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:08 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.info" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:08 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.info is being set with open permissions: ugo+rw Nov 01 09:53:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:08 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.info Nov 01 09:53:08 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:08 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.info" returned: 0 in 0.233s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:08 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7b9eeb15-33e1-474b-99ab-367029baef60 tempest-CreateVolumesFromSnapshotTest-374463721 None] Create snapshot completed successfully Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (895bbf8e-1b8d-428a-9443-2e9fb09534ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aab353-7ee2-4a10-86d8-8901466fa67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aab353-7ee2-4a10-86d8-8901466fa67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579469386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c549ef0-c918-4ba1-9c89-785d422f129c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:09Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b985081d-e319-486c-a9bf-6d5e5b7a786e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b985081d-e319-486c-a9bf-6d5e5b7a786e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fcee50-1536-42f9-9fae-7c43d556159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93fcee50-1536-42f9-9fae-7c43d556159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c549ef0-c918-4ba1-9c89-785d422f129c', 'volume_name': 'volume-4c549ef0-c918-4ba1-9c89-785d422f129c', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70c5375-a6d4-4c81-8753-7e4a6de9aca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e70c5375-a6d4-4c81-8753-7e4a6de9aca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc067ee-3784-4ffb-8e26-b1d974b8d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume 4c549ef0-c918-4ba1-9c89-785d422f129c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c549ef0-c918-4ba1-9c89-785d422f129c', 'volume_size': 1} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1579469386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c549ef0-c918-4ba1-9c89-785d422f129c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:09Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Creating volume 4c549ef0-c918-4ba1-9c89-785d422f129c {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:09 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:09 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c 1073741824 Nov 01 09:53:09 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (b90a8788-eca0-48c7-8d29-e1035e2c9963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0332e-ce76-4b35-bff9-dd4238a5e383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0332e-ce76-4b35-bff9-dd4238a5e383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862085459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef1044b-a36c-4844-84ae-4e7e1ab27ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:09Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c6b565-0c2a-4582-922f-2b157c7498c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39c6b565-0c2a-4582-922f-2b157c7498c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e62821d-bc4e-436f-bb13-ed0fbb7fcf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e62821d-bc4e-436f-bb13-ed0fbb7fcf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef1044b-a36c-4844-84ae-4e7e1ab27ddd', 'volume_name': 'volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52570108-3b23-4464-889f-9aabfa2ee1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52570108-3b23-4464-889f-9aabfa2ee1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e304cf-f1dd-430f-938b-8b6d629ce785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume 2ef1044b-a36c-4844-84ae-4e7e1ab27ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd', 'volume_size': 1} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:09 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c 1073741824" returned: 0 in 0.505s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:09 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c Nov 01 09:53:09 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (a9820297-7284-4ba3-8289-2a6a98bec9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68989061-7629-4b20-bdc3-6c5bdef0ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68989061-7629-4b20-bdc3-6c5bdef0ee72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967306864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bad7b73-0bca-4ef6-8730-68a7f6fbac6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:10Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe26a72-a64f-4ac3-ab51-ddf35bcf51c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe26a72-a64f-4ac3-ab51-ddf35bcf51c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9763ce45-4b2c-410d-bab4-e0476f26767a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9763ce45-4b2c-410d-bab4-e0476f26767a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bad7b73-0bca-4ef6-8730-68a7f6fbac6b', 'volume_name': 'volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678d546a-a810-4744-bb58-f95abcc9f971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678d546a-a810-4744-bb58-f95abcc9f971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386e9fab-5782-4279-b2a6-98121892c0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume 9bad7b73-0bca-4ef6-8730-68a7f6fbac6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b', 'volume_size': 1} Nov 01 09:53:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:10 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c" returned: 0 in 0.305s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-862085459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef1044b-a36c-4844-84ae-4e7e1ab27ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:09Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Creating volume 2ef1044b-a36c-4844-84ae-4e7e1ab27ddd {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:10 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc067ee-3784-4ffb-8e26-b1d974b8d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c549ef0-c918-4ba1-9c89-785d422f129c', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd1aa12-0607-4253-9006-34bdc138b80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd 1073741824 Nov 01 09:53:10 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:10 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume volume-4c549ef0-c918-4ba1-9c89-785d422f129c (4c549ef0-c918-4ba1-9c89-785d422f129c): created successfully Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd1aa12-0607-4253-9006-34bdc138b80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (895bbf8e-1b8d-428a-9443-2e9fb09534ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-115a76b0-4bee-424d-8608-32a2b4eb5dc3 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created volume successfully. Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (10ea9866-6a8d-42bd-9950-4d6ab34d4be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f8a9c3-db8e-4002-a00b-c5081f0a2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f8a9c3-db8e-4002-a00b-c5081f0a2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121401929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86007be-7446-4117-a70a-d781fa853064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:10Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8613f6fb-7ec6-43bf-81ea-3a533835160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8613f6fb-7ec6-43bf-81ea-3a533835160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2545d746-8f39-4236-9474-7ff2e93f9421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2545d746-8f39-4236-9474-7ff2e93f9421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c86007be-7446-4117-a70a-d781fa853064', 'volume_name': 'volume-c86007be-7446-4117-a70a-d781fa853064', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6d9955-18cf-42a8-b7b4-9928b545f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6d9955-18cf-42a8-b7b4-9928b545f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3056272-4734-44cf-beb2-f3160bc75967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume c86007be-7446-4117-a70a-d781fa853064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c86007be-7446-4117-a70a-d781fa853064', 'volume_size': 1} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:10 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (a785f21b-714f-473d-9204-0ad378d93d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bda18a-f994-4799-9850-c76066665fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd 1073741824" returned: 0 in 0.567s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9bda18a-f994-4799-9850-c76066665fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2142646634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8216fd-a60f-4f10-8a1d-66fe4e39918b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:11Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698df235-64a4-46ef-9da5-620276cf9c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698df235-64a4-46ef-9da5-620276cf9c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4460ae5f-8d50-4af8-978f-3a67930e8de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4460ae5f-8d50-4af8-978f-3a67930e8de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8216fd-a60f-4f10-8a1d-66fe4e39918b', 'volume_name': 'volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfa2d02-d5ab-4258-93b9-66b39e325e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfa2d02-d5ab-4258-93b9-66b39e325e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1791b075-98b2-4f29-a6da-26436476e57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:10 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume 8e8216fd-a60f-4f10-8a1d-66fe4e39918b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b', 'volume_size': 1} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:10 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd Nov 01 09:53:10 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:10 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd" returned: 0 in 0.245s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1967306864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bad7b73-0bca-4ef6-8730-68a7f6fbac6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:10Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Creating volume 9bad7b73-0bca-4ef6-8730-68a7f6fbac6b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:10 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e304cf-f1dd-430f-938b-8b6d629ce785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f371357d-5cb4-48aa-a9f5-71519af16ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:11 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b 1073741824 Nov 01 09:53:11 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:11 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd (2ef1044b-a36c-4844-84ae-4e7e1ab27ddd): created successfully Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f371357d-5cb4-48aa-a9f5-71519af16ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (b90a8788-eca0-48c7-8d29-e1035e2c9963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-15124d35-d071-4983-99c3-41cc30e0cf55 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created volume successfully. Nov 01 09:53:11 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b 1073741824" returned: 0 in 0.414s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:11 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b Nov 01 09:53:11 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:11 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b" returned: 0 in 0.257s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.391s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2121401929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c86007be-7446-4117-a70a-d781fa853064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:10Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Creating volume c86007be-7446-4117-a70a-d781fa853064 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:11 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:11 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 1073741824 Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386e9fab-5782-4279-b2a6-98121892c0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:11 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b94ad91-057b-4b5b-a466-0c90fccd9ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:11 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b (9bad7b73-0bca-4ef6-8730-68a7f6fbac6b): created successfully Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b94ad91-057b-4b5b-a466-0c90fccd9ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:11 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (a9820297-7284-4ba3-8289-2a6a98bec9d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2bb321da-3431-42f0-966e-eb8684807942 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created volume successfully. Nov 01 09:53:12 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 1073741824" returned: 0 in 0.407s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:12 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 Nov 01 09:53:12 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:12 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064" returned: 0 in 0.243s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.684s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2142646634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8216fd-a60f-4f10-8a1d-66fe4e39918b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08032b7375a74574a4b50d5291d69f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:11Z,use_quota=True,user_id='7008c1fd1d7148ebaf384ae7d849d00c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Creating volume 8e8216fd-a60f-4f10-8a1d-66fe4e39918b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:12 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3056272-4734-44cf-beb2-f3160bc75967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c86007be-7446-4117-a70a-d781fa853064', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:12 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b 1073741824 Nov 01 09:53:12 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6697bec7-7d09-44b6-bdd2-483faff85253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume volume-c86007be-7446-4117-a70a-d781fa853064 (c86007be-7446-4117-a70a-d781fa853064): created successfully Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6697bec7-7d09-44b6-bdd2-483faff85253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (10ea9866-6a8d-42bd-9950-4d6ab34d4be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:12 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-60f4358c-d3cd-4140-ac66-b59161a6c85a tempest-CreateVolumesFromSnapshotTest-374463721 None] Created volume successfully. Nov 01 09:53:12 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b 1073741824" returned: 0 in 0.440s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:12 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b Nov 01 09:53:12 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:13 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b" returned: 0 in 0.251s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1791b075-98b2-4f29-a6da-26436476e57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b60663-ca57-48d7-894c-a7bdeb4c0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Volume volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b (8e8216fd-a60f-4f10-8a1d-66fe4e39918b): created successfully Nov 01 09:53:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4b60663-ca57-48d7-894c-a7bdeb4c0417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Flow 'volume_create_manager' (a785f21b-714f-473d-9204-0ad378d93d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:13 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-548fba59-95ac-4922-8b66-e2d28e63b3ba tempest-CreateVolumesFromSnapshotTest-374463721 None] Created volume successfully. Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-8e8216fd-a60f-4f10-8a1d-66fe4e39918b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-8e8216fd-a60f-4f10-8a1d-66fe4e39918b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-quobyte-8e8216fd-a60f-4f10-8a1d-66fe4e39918b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-8e8216fd-a60f-4f10-8a1d-66fe4e39918b" acquired by "delete_volume" :: waited 0.013s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77cd52c-b50d-4253-83b8-74ad2bc4aa2e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:14 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b Nov 01 09:53:14 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:14 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:14 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b Nov 01 09:53:14 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:14 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8e8216fd-a60f-4f10-8a1d-66fe4e39918b" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-8e8216fd-a60f-4f10-8a1d-66fe4e39918b" released by "delete_volume" :: held 0.630s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created reservations ['e886edd5-aab2-493c-a2ee-dcb33296c22e', '68c865c5-f1ef-4d0c-b0ca-090d139a9b48', '5cd5e4ad-6a44-4ab0-a94d-54b4880b3971', '1fa6e096-dbba-4626-965a-a5288ffa0ac2'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:14 devstack sudo[105165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:14 devstack sudo[105165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:15 devstack sudo[105165]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.244s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Deleted volume successfully. Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0f82a8b4-c350-4c13-b236-5d0b15445a32 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-8e8216fd-a60f-4f10-8a1d-66fe4e39918b-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-c86007be-7446-4117-a70a-d781fa853064-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-c86007be-7446-4117-a70a-d781fa853064-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-quobyte-c86007be-7446-4117-a70a-d781fa853064" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-c86007be-7446-4117-a70a-d781fa853064" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab3d285-596f-431e-a270-d1c13d206cda]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:15 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 Nov 01 09:53:15 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:15 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064" returned: 0 in 0.369s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:15 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064 Nov 01 09:53:15 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:15 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c86007be-7446-4117-a70a-d781fa853064" returned: 0 in 0.249s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-c86007be-7446-4117-a70a-d781fa853064" released by "delete_volume" :: held 0.661s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created reservations ['8a69446d-e7cb-418e-83be-9e58a3e55a6c', 'a23ac422-bcbf-4fa5-80bb-521833a354ae', '8bd39f10-3ac0-4911-826b-b4f35f413f53', '45c6db10-f638-4808-a704-dcaa6a3cc8cc'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:16 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:16 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:16 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.245s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Deleted volume successfully. Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b733ded9-a743-48e1-8a5b-606b81e55d59 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-c86007be-7446-4117-a70a-d781fa853064-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-quobyte-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc7d50-bc00-4d6b-ad3f-e8909d03764b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:16 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b Nov 01 09:53:16 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:16 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b" returned: 0 in 0.361s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:16 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b Nov 01 09:53:16 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:17 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b" released by "delete_volume" :: held 0.643s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created reservations ['32d4ea9d-0e1f-41c6-9430-27ccb620bd91', '04bf102d-da1c-4ccd-9a51-8c6607258dce', 'cdf2cf8c-2b67-4902-a1be-703107c74c2b', '53c6f5f8-4880-4145-acb5-0fd8d3628919'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:17 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:17 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:17 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.247s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Deleted volume successfully. Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ccd0ac8c-0e4b-4eb9-9326-bfeedbd5e485 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-9bad7b73-0bca-4ef6-8730-68a7f6fbac6b-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-quobyte-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d8a147-b4f0-476e-bd18-fffd66984c9b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:17 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd Nov 01 09:53:17 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:17 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd" returned: 0 in 0.357s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:17 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd Nov 01 09:53:17 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:18 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd" returned: 0 in 0.246s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd" released by "delete_volume" :: held 0.643s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created reservations ['422ffda8-1776-474b-86c3-8c157c937f53', 'e1be6bb9-efc5-43a0-b91f-4b2bc0d0f842', '392614e3-5839-440e-b752-d2777256fa47', 'b349ad56-9208-4af3-80db-9b44cd911c61'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:18 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:18 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:18 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.246s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Deleted volume successfully. Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5f90df1c-686c-48ec-8f1c-7dc0afe7aa40 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-2ef1044b-a36c-4844-84ae-4e7e1ab27ddd-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-4c549ef0-c918-4ba1-9c89-785d422f129c-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-4c549ef0-c918-4ba1-9c89-785d422f129c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-quobyte-4c549ef0-c918-4ba1-9c89-785d422f129c" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-4c549ef0-c918-4ba1-9c89-785d422f129c" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89f370-174e-40b5-b0bd-4a8062ee6a41]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:18 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c Nov 01 09:53:18 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:19 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c" returned: 0 in 0.349s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:19 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c Nov 01 09:53:19 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:19 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4c549ef0-c918-4ba1-9c89-785d422f129c" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-4c549ef0-c918-4ba1-9c89-785d422f129c" released by "delete_volume" :: held 0.637s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created reservations ['3166ffd9-41d6-4817-9a0f-aa3378487382', '9abc0f4c-cfba-42cc-bd9c-db4e2a21de7d', '53d55aa0-5d6f-4fa1-9e34-16e86bf3a1a8', '05e6c2d7-611a-432d-bf4c-fc5ea1d4b300'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:19 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:19 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:19 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.249s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Deleted volume successfully. Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cde1f2a1-674e-4a9d-b97e-4a47addcf197 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-4c549ef0-c918-4ba1-9c89-785d422f129c-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-bf8e5079-6a0e-486d-ba5c-09f3809551c3-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-bf8e5079-6a0e-486d-ba5c-09f3809551c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-quobyte-23da44b0-a020-4063-a087-2cb5ab051aaa" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-23da44b0-a020-4063-a087-2cb5ab051aaa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-quobyte-bf8e5079-6a0e-486d-ba5c-09f3809551c3" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-bf8e5079-6a0e-486d-ba5c-09f3809551c3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Deleting offline snapshot bf8e5079-6a0e-486d-ba5c-09f3809551c3 of volume 23da44b0-a020-4063-a087-2cb5ab051aaa {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] snapshot_file for this snap is: volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[36597ce6-cb94-446f-ab8c-e51d2d83e5da]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:19 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 Nov 01 09:53:19 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:20 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3" returned: 0 in 0.357s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23da44b0-a020-4063-a087-2cb5ab051aaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:53:20 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c9183f-f6bb-4b87-830d-c81e190e9459]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:20 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa Nov 01 09:53:20 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:20 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa" returned: 0 in 0.358s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:20 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 Nov 01 09:53:20 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:20 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3" returned: 0 in 0.334s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:20 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3 Nov 01 09:53:20 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:21 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa.bf8e5079-6a0e-486d-ba5c-09f3809551c3" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-bf8e5079-6a0e-486d-ba5c-09f3809551c3" released by "_delete_snapshot" :: held 1.389s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-23da44b0-a020-4063-a087-2cb5ab051aaa" released by "delete_snapshot" :: held 1.411s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:21 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Created reservations ['193ba7b5-9989-4dcc-a5aa-c48491fd1a70', 'b3b53f09-fea9-4393-afa9-81bd693829d6', '12c19f65-e934-4b66-9301-6f36499cbfef', 'e41ac06b-689e-45a0-be39-cfe37007b6f5'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:21 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Delete snapshot completed successfully. Nov 01 09:53:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f5cefaeb-d050-4f06-b86f-f670cce84449 tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-bf8e5079-6a0e-486d-ba5c-09f3809551c3-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-23da44b0-a020-4063-a087-2cb5ab051aaa-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-23da44b0-a020-4063-a087-2cb5ab051aaa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "cinder-quobyte-23da44b0-a020-4063-a087-2cb5ab051aaa" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-23da44b0-a020-4063-a087-2cb5ab051aaa" acquired by "delete_volume" :: waited 0.013s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f5c96c-a42b-4b6d-9c73-b6577b83702e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:22 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa Nov 01 09:53:22 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:22 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:22 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa Nov 01 09:53:22 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:22 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-23da44b0-a020-4063-a087-2cb5ab051aaa" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-quobyte-23da44b0-a020-4063-a087-2cb5ab051aaa" released by "delete_volume" :: held 0.666s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Created reservations ['85ba0e9b-5bbb-4e10-ab8c-331b0435c847', 'e191dbfe-9403-41df-88a9-7b09cf365759', 'accc8f3c-304a-4d21-a806-8ed8c197cfcb', '35dc27a5-bfe0-4316-87fc-0f248d05ac2f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:22 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:22 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:23 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:23 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:23 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Deleted volume successfully. Nov 01 09:53:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0dff8adc-90d3-4a18-ada6-a1f65ee4207f tempest-CreateVolumesFromSnapshotTest-374463721 None] Lock "cinder-23da44b0-a020-4063-a087-2cb5ab051aaa-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (87d235c6-5252-4b7e-a33e-fe6d21ca106d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9139841-84c6-4c94-afef-831522ff8526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9139841-84c6-4c94-afef-831522ff8526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1341042970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa828a7-b43b-4f8f-804c-fafc4ad328dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:26Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea579379-256b-4c25-832e-73bf53caae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea579379-256b-4c25-832e-73bf53caae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff03c3c-ee69-452a-b44d-0c02b045c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff03c3c-ee69-452a-b44d-0c02b045c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa828a7-b43b-4f8f-804c-fafc4ad328dd', 'volume_name': 'volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610be4ae-e5c5-4f84-94b9-6c7570f5cbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610be4ae-e5c5-4f84-94b9-6c7570f5cbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacf6d02-d6a2-49ed-8d51-ffb1374796ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:25 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume aaa828a7-b43b-4f8f-804c-fafc4ad328dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd', 'volume_size': 1} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1341042970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa828a7-b43b-4f8f-804c-fafc4ad328dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:26Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Creating volume aaa828a7-b43b-4f8f-804c-fafc4ad328dd {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:25 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:25 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd 1073741824 Nov 01 09:53:25 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:26 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd 1073741824" returned: 0 in 0.402s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:26 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd Nov 01 09:53:26 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:26 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd" returned: 0 in 0.237s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dacf6d02-d6a2-49ed-8d51-ffb1374796ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361fbecf-4a26-487a-a236-221b6278e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:26 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd (aaa828a7-b43b-4f8f-804c-fafc4ad328dd): created successfully Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361fbecf-4a26-487a-a236-221b6278e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (87d235c6-5252-4b7e-a33e-fe6d21ca106d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a0b87a56-8d8a-4777-be0f-7d3f0a010807 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created volume successfully. Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (defe7471-7bb8-4ab8-86c5-71c7b1321e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3c772e-c888-4eaa-91fb-49480dcb5e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3c772e-c888-4eaa-91fb-49480dcb5e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-195990307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8942d34-5193-407d-ad17-746f195aa381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:27Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb82dbb8-0811-4082-881c-412db1610023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb82dbb8-0811-4082-881c-412db1610023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bf2a7d-78f9-4435-8cfa-102751c882ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9bf2a7d-78f9-4435-8cfa-102751c882ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8942d34-5193-407d-ad17-746f195aa381', 'volume_name': 'volume-d8942d34-5193-407d-ad17-746f195aa381', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b206a3f9-e883-427b-a623-324b00f6d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b206a3f9-e883-427b-a623-324b00f6d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e584cbaa-65e5-4385-b688-960aa0055ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume d8942d34-5193-407d-ad17-746f195aa381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8942d34-5193-407d-ad17-746f195aa381', 'volume_size': 1} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-195990307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8942d34-5193-407d-ad17-746f195aa381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:27Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Creating volume d8942d34-5193-407d-ad17-746f195aa381 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:27 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:27 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 1073741824 Nov 01 09:53:27 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (3d59d95d-cd50-47a2-bf07-e6102ea3d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3689fa-bad5-4ecd-aa2c-77f26fd2b702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba3689fa-bad5-4ecd-aa2c-77f26fd2b702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1555771029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0ee15c-8f73-4a7b-abbd-3e425b6e895d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:27Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7042eff7-e2ed-4367-8d61-6887720b7c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7042eff7-e2ed-4367-8d61-6887720b7c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543f5f91-21a8-4932-a46d-d3037a46847e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543f5f91-21a8-4932-a46d-d3037a46847e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f0ee15c-8f73-4a7b-abbd-3e425b6e895d', 'volume_name': 'volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59e65cd-95e1-4444-b158-d533d8cd2fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59e65cd-95e1-4444-b158-d533d8cd2fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b74440-b167-4af0-9ba3-6e267aff12b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume 2f0ee15c-8f73-4a7b-abbd-3e425b6e895d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d', 'volume_size': 1} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:27 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 1073741824" returned: 0 in 0.462s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:27 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 Nov 01 09:53:27 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (3bc7cab1-0e1f-443c-847b-64440e30af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0bed7a-5840-4c1f-ae2e-a861d51ba857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df0bed7a-5840-4c1f-ae2e-a861d51ba857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205717776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b083ae3c-21ec-4138-b650-e278eff8d93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:28Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d39f91-f335-46b6-9406-4a70d1a28e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d39f91-f335-46b6-9406-4a70d1a28e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771785fc-ec91-470b-82b0-b63f04c8ffe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771785fc-ec91-470b-82b0-b63f04c8ffe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b083ae3c-21ec-4138-b650-e278eff8d93e', 'volume_name': 'volume-b083ae3c-21ec-4138-b650-e278eff8d93e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33a4ec2-e662-4916-9e18-2ac4c9a9cba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33a4ec2-e662-4916-9e18-2ac4c9a9cba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f790ef90-61c2-47dd-8296-df6ec7e0f6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume b083ae3c-21ec-4138-b650-e278eff8d93e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b083ae3c-21ec-4138-b650-e278eff8d93e', 'volume_size': 1} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:27 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381" returned: 0 in 0.284s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1555771029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f0ee15c-8f73-4a7b-abbd-3e425b6e895d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:27Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Creating volume 2f0ee15c-8f73-4a7b-abbd-3e425b6e895d {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:27 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e584cbaa-65e5-4385-b688-960aa0055ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8942d34-5193-407d-ad17-746f195aa381', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:27 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d 1073741824 Nov 01 09:53:27 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a95a775-1fea-4312-ba03-f785d1fcf29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:27 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume volume-d8942d34-5193-407d-ad17-746f195aa381 (d8942d34-5193-407d-ad17-746f195aa381): created successfully Nov 01 09:53:27 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a95a775-1fea-4312-ba03-f785d1fcf29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (defe7471-7bb8-4ab8-86c5-71c7b1321e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-016d6be0-eca5-4daa-ac2a-85de83494fff tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created volume successfully. Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (2e35e17a-36e2-4d74-ad6c-35c9c49f0aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc87b48-670a-4839-aa2a-5b04d2404bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc87b48-670a-4839-aa2a-5b04d2404bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139102277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cccc31-b26b-4249-bdf2-60d6aecbeffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:28Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0416f32-a25a-48a8-bb5f-5526eb776bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0416f32-a25a-48a8-bb5f-5526eb776bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831b386d-823a-4976-81d3-88220b244872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831b386d-823a-4976-81d3-88220b244872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cccc31-b26b-4249-bdf2-60d6aecbeffd', 'volume_name': 'volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7e587b-0346-4c66-afbd-e5f7274cb934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7e587b-0346-4c66-afbd-e5f7274cb934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51806a5d-38bb-4cc0-bb9d-4dd5b12c90e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume 84cccc31-b26b-4249-bdf2-60d6aecbeffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd', 'volume_size': 1} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:28 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d 1073741824" returned: 0 in 0.531s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:28 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d Nov 01 09:53:28 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (bdd63344-4ac5-4ef5-ac52-741edd2a60fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1710515-23c6-435a-a842-c7765882834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1710515-23c6-435a-a842-c7765882834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1706702524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:28Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490d010f-9d80-4f61-b0e7-31eda1c10ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490d010f-9d80-4f61-b0e7-31eda1c10ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dd8416-1707-4258-97ba-d89457dfdfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98dd8416-1707-4258-97ba-d89457dfdfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d', 'volume_name': 'volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4744b531-f171-4cec-8e40-1d6462c6dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4744b531-f171-4cec-8e40-1d6462c6dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9505634-6bf9-4b8a-92d7-853aa6cf1cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d', 'volume_size': 1} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:28 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1205717776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b083ae3c-21ec-4138-b650-e278eff8d93e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:28Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Creating volume b083ae3c-21ec-4138-b650-e278eff8d93e {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:28 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b74440-b167-4af0-9ba3-6e267aff12b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e 1073741824 Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25787905-b472-438c-b3cb-231d3e67ff30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:28 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d (2f0ee15c-8f73-4a7b-abbd-3e425b6e895d): created successfully Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25787905-b472-438c-b3cb-231d3e67ff30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (3d59d95d-cd50-47a2-bf07-e6102ea3d35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d6acc759-daf9-4f4a-994d-ac17f5c930be tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created volume successfully. Nov 01 09:53:29 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e 1073741824" returned: 0 in 0.405s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:29 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e Nov 01 09:53:29 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:29 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e" returned: 0 in 0.237s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139102277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cccc31-b26b-4249-bdf2-60d6aecbeffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:28Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Creating volume 84cccc31-b26b-4249-bdf2-60d6aecbeffd {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:29 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f790ef90-61c2-47dd-8296-df6ec7e0f6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b083ae3c-21ec-4138-b650-e278eff8d93e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:29 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd 1073741824 Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59489cc1-178a-401c-9196-068f2e3b9e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:29 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:29 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume volume-b083ae3c-21ec-4138-b650-e278eff8d93e (b083ae3c-21ec-4138-b650-e278eff8d93e): created successfully Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59489cc1-178a-401c-9196-068f2e3b9e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (3bc7cab1-0e1f-443c-847b-64440e30af61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-60408457-2b70-4f12-ba06-6ac79cbe19af tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created volume successfully. Nov 01 09:53:29 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd 1073741824" returned: 0 in 0.410s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:29 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd Nov 01 09:53:29 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:30 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd" returned: 0 in 0.240s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.528s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1706702524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8bc58d74fb4144a4bc294d9f2fa742',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:28Z,use_quota=True,user_id='817ac8d03d7f45dbb28d32b5a35db79f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Creating volume cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:30 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51806a5d-38bb-4cc0-bb9d-4dd5b12c90e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beab275d-e26c-48b5-9639-abc6566485b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:30 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d 1073741824 Nov 01 09:53:30 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd (84cccc31-b26b-4249-bdf2-60d6aecbeffd): created successfully Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beab275d-e26c-48b5-9639-abc6566485b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (2e35e17a-36e2-4d74-ad6c-35c9c49f0aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8e022f2c-d1ad-4259-bd15-6e11c6434a85 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created volume successfully. Nov 01 09:53:30 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d 1073741824" returned: 0 in 0.407s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:30 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d Nov 01 09:53:30 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:30 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d" returned: 0 in 0.234s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9505634-6bf9-4b8a-92d7-853aa6cf1cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2776826-27dd-4432-9e42-b61d49192ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Volume volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d (cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d): created successfully Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2776826-27dd-4432-9e42-b61d49192ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Flow 'volume_create_manager' (bdd63344-4ac5-4ef5-ac52-741edd2a60fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-14075672-3974-45f3-bb0d-8eabfa5d4c13 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created volume successfully. Nov 01 09:53:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-quobyte-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:31 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44efeb4b-9036-48fb-8625-d3cf4d08a235]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:32 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d Nov 01 09:53:32 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:32 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d" returned: 0 in 0.342s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:32 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d Nov 01 09:53:32 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:32 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d" returned: 0 in 0.241s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d" released by "delete_volume" :: held 0.625s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created reservations ['afba6370-af17-4b8d-9449-c29ce303005c', '109a14d3-c6fe-405e-8ee6-7e95add55111', 'f35b5b0c-e443-4db2-ae70-6923b4674a4c', 'e3e4ce0c-f975-4c6d-b7f3-4943116888ee'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:32 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:32 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:32 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Deleted volume successfully. Nov 01 09:53:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39d2def5-274d-4d37-8256-cfb96b8ac7f0 tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-cc4ff1be-8aa6-4ba6-9e90-c0c4e316892d-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-84cccc31-b26b-4249-bdf2-60d6aecbeffd-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-84cccc31-b26b-4249-bdf2-60d6aecbeffd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-quobyte-84cccc31-b26b-4249-bdf2-60d6aecbeffd" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-84cccc31-b26b-4249-bdf2-60d6aecbeffd" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e9dbda-a4f2-43dd-b26a-8741cfe05bd3]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:33 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd Nov 01 09:53:33 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:33 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd" returned: 0 in 0.355s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:33 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd Nov 01 09:53:33 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:33 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-84cccc31-b26b-4249-bdf2-60d6aecbeffd" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-84cccc31-b26b-4249-bdf2-60d6aecbeffd" released by "delete_volume" :: held 0.635s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created reservations ['43958f63-9799-46d6-b9d8-59bd2b84114a', '2026aedf-a711-46ff-89ac-516525cf800a', '3c9f79df-9f22-4c8e-9abf-294f718187b7', '68c642cc-809a-48ab-b137-327a93358a5f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:33 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:33 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:34 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.238s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:34 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Deleted volume successfully. Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-204273cf-2e86-459f-858c-2310e788baca tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-84cccc31-b26b-4249-bdf2-60d6aecbeffd-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-b083ae3c-21ec-4138-b650-e278eff8d93e-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-b083ae3c-21ec-4138-b650-e278eff8d93e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-quobyte-b083ae3c-21ec-4138-b650-e278eff8d93e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-b083ae3c-21ec-4138-b650-e278eff8d93e" acquired by "delete_volume" :: waited 0.013s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fb44d9-1f76-4dd3-86f8-a1a93452020b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:34 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e Nov 01 09:53:34 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:34 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e" returned: 0 in 0.353s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:34 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e Nov 01 09:53:34 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:34 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b083ae3c-21ec-4138-b650-e278eff8d93e" returned: 0 in 0.238s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-b083ae3c-21ec-4138-b650-e278eff8d93e" released by "delete_volume" :: held 0.632s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created reservations ['811a31e6-fa2d-41ef-9f3e-ddc805952d8d', '0f8bc57f-222c-47c9-9d4e-cbc5261dc521', '99a723de-a84a-4291-846d-993514400fe7', '408adcc5-21b7-42c2-86f4-18f814df0570'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:34 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:34 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:35 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.245s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Deleted volume successfully. Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eeca929d-b4bc-452b-a0ad-63066d17a42e tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-b083ae3c-21ec-4138-b650-e278eff8d93e-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-quobyte-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5497ae-8a6c-4687-8f1d-8e7c2d17648b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:35 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d Nov 01 09:53:35 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:35 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d" returned: 0 in 0.347s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:35 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d Nov 01 09:53:35 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:36 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d" returned: 0 in 0.269s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d" released by "delete_volume" :: held 0.658s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created reservations ['dbc6b74e-01b2-4313-b1e9-4703dbcf1607', '35d71184-0370-46dd-ab5a-4664b615d5cf', '78f6459c-6376-4bc9-9740-cba323b5a3a6', '2bfeb1ee-a4e6-4e2d-b427-02a0933e2c76'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:36 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:36 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:36 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Deleted volume successfully. Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-98286a92-22ea-47fd-8233-12a33184141a tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-2f0ee15c-8f73-4a7b-abbd-3e425b6e895d-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-d8942d34-5193-407d-ad17-746f195aa381-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-d8942d34-5193-407d-ad17-746f195aa381-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-quobyte-d8942d34-5193-407d-ad17-746f195aa381" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-d8942d34-5193-407d-ad17-746f195aa381" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0eca28-aee7-400c-bff9-4bd000894cb4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:36 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 Nov 01 09:53:36 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:36 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381" returned: 0 in 0.346s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:36 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381 Nov 01 09:53:36 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:37 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-d8942d34-5193-407d-ad17-746f195aa381" returned: 0 in 0.237s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-d8942d34-5193-407d-ad17-746f195aa381" released by "delete_volume" :: held 0.622s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created reservations ['38918f84-4d3a-4c5f-8f96-08d8e393b1de', 'd1a1d924-ae11-4673-b693-e0b40e328516', '87a74931-131a-4027-b21a-3ddfd8aa1ba0', '493dcf2b-a8b8-4d7b-bfbe-0cee4c80050a'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:37 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:37 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:37 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Deleted volume successfully. Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a2c1619b-7ff3-4bcc-91a7-79398aa313cc tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-d8942d34-5193-407d-ad17-746f195aa381-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-aaa828a7-b43b-4f8f-804c-fafc4ad328dd-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-aaa828a7-b43b-4f8f-804c-fafc4ad328dd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "cinder-quobyte-aaa828a7-b43b-4f8f-804c-fafc4ad328dd" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-aaa828a7-b43b-4f8f-804c-fafc4ad328dd" acquired by "delete_volume" :: waited 0.012s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8247e5c-86f0-4bc0-b8cc-59f5756bf2ea]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:37 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd Nov 01 09:53:37 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:38 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd" returned: 0 in 0.363s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:38 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd Nov 01 09:53:38 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:38 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-aaa828a7-b43b-4f8f-804c-fafc4ad328dd" returned: 0 in 0.238s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-quobyte-aaa828a7-b43b-4f8f-804c-fafc4ad328dd" released by "delete_volume" :: held 0.640s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Created reservations ['ac90a884-6ccc-4133-ab54-795b63d7da7d', 'a52212c5-8f7b-48c6-91d2-c99540e52e62', '4b2d6ca5-b6c6-4853-881f-216c93b6f2da', '8da0d31c-4e05-42ca-92cf-7a1a672bb604'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:38 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:38 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:38 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:38 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Deleted volume successfully. Nov 01 09:53:38 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6b23924f-ed12-4ed9-a4ad-c046914d7d0b tempest-CreateVolumesFromSourceVolumeTest-1862451886 None] Lock "cinder-aaa828a7-b43b-4f8f-804c-fafc4ad328dd-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Flow 'volume_create_manager' (951be5b3-4bd1-4a8e-a06b-ba4073a34408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211680d4-3de2-4f9b-9157-732a8e306d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211680d4-3de2-4f9b-9157-732a8e306d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8fd74bff74d0690603e883a22fb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:41Z,use_quota=True,user_id='881b741bc1424dc5bc7062531481afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c328d2-d525-4a4f-9f95-bcad4bfa70c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c328d2-d525-4a4f-9f95-bcad4bfa70c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dfd5239-3c23-4607-b8a3-b559a558c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dfd5239-3c23-4607-b8a3-b559a558c023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12', 'volume_name': 'volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786246c0-c1db-4fd2-8bdf-971b1b5c87c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786246c0-c1db-4fd2-8bdf-971b1b5c87c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b6ca4f-4e80-4007-a6ce-de3d33d05933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:41 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Volume 1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12', 'volume_size': 1} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8fd74bff74d0690603e883a22fb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:41Z,use_quota=True,user_id='881b741bc1424dc5bc7062531481afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Creating volume 1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:41 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:41 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 1073741824 Nov 01 09:53:41 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:41 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 1073741824" returned: 0 in 0.400s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:41 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 Nov 01 09:53:41 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:42 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12" returned: 0 in 0.241s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66b6ca4f-4e80-4007-a6ce-de3d33d05933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c002655-6eb0-4e33-a895-66101325f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:42 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Volume volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 (1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12): created successfully Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c002655-6eb0-4e33-a895-66101325f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Flow 'volume_create_manager' (951be5b3-4bd1-4a8e-a06b-ba4073a34408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-da1360c5-c9c4-4476-bbba-52d6ef78e897 tempest-CinderUnicodeTest-1759897196 None] Created volume successfully. Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Flow 'volume_create_manager' (25008ea7-4ee7-4c1a-baf9-bff59c6c802c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce742aa-5660-4b08-8c09-41cfc1c17523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce742aa-5660-4b08-8c09-41cfc1c17523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-158060155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4f256d-2a9e-4723-8573-c39d72bc8a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8fd74bff74d0690603e883a22fb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:43Z,use_quota=True,user_id='881b741bc1424dc5bc7062531481afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5f6f55-aa5d-4793-b833-54cf59876dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5f6f55-aa5d-4793-b833-54cf59876dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d9bbe4-5f5b-4a7a-9f3b-aadf73d8c840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d9bbe4-5f5b-4a7a-9f3b-aadf73d8c840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4f256d-2a9e-4723-8573-c39d72bc8a93', 'volume_name': 'volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61453309-bcfb-4bb5-b833-bb4a624104e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61453309-bcfb-4bb5-b833-bb4a624104e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3669da2-6d3e-41f4-83ba-bf998a010e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:42 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Volume 3a4f256d-2a9e-4723-8573-c39d72bc8a93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93', 'volume_size': 1} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:53:43Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-158060155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4f256d-2a9e-4723-8573-c39d72bc8a93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68d8fd74bff74d0690603e883a22fb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:53:43Z,use_quota=True,user_id='881b741bc1424dc5bc7062531481afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Creating volume 3a4f256d-2a9e-4723-8573-c39d72bc8a93 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:53:42 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:53:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:42 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 1073741824 Nov 01 09:53:42 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:43 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 1073741824" returned: 0 in 0.404s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:43 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 Nov 01 09:53:43 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:43 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3669da2-6d3e-41f4-83ba-bf998a010e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5196ad3d-4584-4189-a555-05496f3fc45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:53:43 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Volume volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 (3a4f256d-2a9e-4723-8573-c39d72bc8a93): created successfully Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5196ad3d-4584-4189-a555-05496f3fc45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:53:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Flow 'volume_create_manager' (25008ea7-4ee7-4c1a-baf9-bff59c6c802c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:53:43 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fe9fc8a1-0411-44cf-b36c-9c38629e633d tempest-CinderUnicodeTest-1759897196 None] Created volume successfully. Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Creating offline snapshot 356057a2-2e84-425c-af0b-e5b31f905912 of volume 3a4f256d-2a9e-4723-8573-c39d72bc8a93 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[acba17c6-fee0-4f05-b9e7-5aabb28564bd]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:44 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 Nov 01 09:53:44 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:44 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93" returned: 0 in 0.345s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:44 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 1G Nov 01 09:53:44 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:44 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 1G" returned: 0 in 0.400s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:44 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 Nov 01 09:53:44 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:45 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912" returned: 0 in 0.293s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:45 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 is being set with open permissions: ugo+rw Nov 01 09:53:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:45 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 Nov 01 09:53:45 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:45 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912" returned: 0 in 0.238s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:45 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.info Nov 01 09:53:45 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:45 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.info" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:45 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.info is being set with open permissions: ugo+rw Nov 01 09:53:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:45 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.info Nov 01 09:53:45 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:45 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.info" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2184cfaa-424e-486e-90af-e47a63352ff6 tempest-CinderUnicodeTest-1759897196 None] Create snapshot completed successfully Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "cinder-356057a2-2e84-425c-af0b-e5b31f905912-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-356057a2-2e84-425c-af0b-e5b31f905912-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "cinder-quobyte-3a4f256d-2a9e-4723-8573-c39d72bc8a93" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-quobyte-3a4f256d-2a9e-4723-8573-c39d72bc8a93" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "cinder-quobyte-356057a2-2e84-425c-af0b-e5b31f905912" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-quobyte-356057a2-2e84-425c-af0b-e5b31f905912" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Deleting offline snapshot 356057a2-2e84-425c-af0b-e5b31f905912 of volume 3a4f256d-2a9e-4723-8573-c39d72bc8a93 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] snapshot_file for this snap is: volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[becb8789-2ae9-49ed-9555-016d1566400d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:46 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 Nov 01 09:53:46 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:46 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912" returned: 0 in 0.383s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[499efd80-7913-4e6d-aff7-7c3d0539fe7c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:46 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 Nov 01 09:53:46 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:47 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93" returned: 0 in 0.352s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:47 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 Nov 01 09:53:47 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:47 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912" returned: 0 in 0.321s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:47 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912 Nov 01 09:53:47 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:47 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93.356057a2-2e84-425c-af0b-e5b31f905912" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-quobyte-356057a2-2e84-425c-af0b-e5b31f905912" released by "_delete_snapshot" :: held 1.419s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-quobyte-3a4f256d-2a9e-4723-8573-c39d72bc8a93" released by "delete_snapshot" :: held 1.441s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Created reservations ['dcf71dd3-5170-47c3-9406-a1e574ca5927', '004c2690-4f39-4d34-92fb-e89febdd47dc', 'fb0f9e47-6571-40e1-8af9-617b963c8fe8', 'eb03afb4-6508-4d32-b435-65126f03deb2'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:47 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Delete snapshot completed successfully. Nov 01 09:53:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9c0b2f7c-2fdd-49bb-a9c3-be1f42d4210a tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-356057a2-2e84-425c-af0b-e5b31f905912-delete_snapshot" released by "delete_snapshot" :: held 1.569s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "cinder-3a4f256d-2a9e-4723-8573-c39d72bc8a93-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-3a4f256d-2a9e-4723-8573-c39d72bc8a93-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "cinder-quobyte-3a4f256d-2a9e-4723-8573-c39d72bc8a93" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-quobyte-3a4f256d-2a9e-4723-8573-c39d72bc8a93" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0195e63-8348-48fb-8a79-6795bbc6bed8]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:48 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 Nov 01 09:53:48 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:48 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93" returned: 0 in 0.355s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:48 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93 Nov 01 09:53:48 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:49 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3a4f256d-2a9e-4723-8573-c39d72bc8a93" returned: 0 in 0.243s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-quobyte-3a4f256d-2a9e-4723-8573-c39d72bc8a93" released by "delete_volume" :: held 0.660s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Created reservations ['5ffd3bc0-93f2-43b4-94c3-12fbf29a0151', '36fb8ef9-3c98-458d-bd31-72ffe1a2800e', '4baa2fe5-9d1c-485e-be86-577890f731e6', 'da04a11a-9b48-4f34-9179-19c161fd02f4'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:49 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:49 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:49 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.234s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Deleted volume successfully. Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-62d0259b-5fe8-4238-a066-8b588422016e tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-3a4f256d-2a9e-4723-8573-c39d72bc8a93-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "cinder-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "cinder-quobyte-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-quobyte-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f64d608-68da-4b65-a56e-55bafa0bd95f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:49 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 Nov 01 09:53:49 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:49 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12" returned: 0 in 0.362s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:49 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12 Nov 01 09:53:49 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:50 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-quobyte-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12" released by "delete_volume" :: held 0.648s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Created reservations ['f1af4ac1-d999-4e13-b277-ce3dabc34122', '26d90f9c-93d5-4725-bc26-8c43f7bfbd96', 'c09ef9a6-8cb2-468e-a7a1-6f5e2b0160b2', '3d072dd6-0635-4825-b32e-b019503e8f73'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:50 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:50 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:50 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.235s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Deleted volume successfully. Nov 01 09:53:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-53cb6084-8984-4074-9d21-2e70294cfe92 tempest-CinderUnicodeTest-1759897196 None] Lock "cinder-1c410b2a-9d31-4f67-bf18-ae9ab1cc0d12-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:53:53 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:53:53 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:53:53 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.264s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:53:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:54:00 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=123,cinder:UPDATE=172,cinder:DELETE=12,cinder:INSERT=37 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:54:00 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=164,cinder:SELECT=109,cinder:INSERT=43,cinder:DELETE=18 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (f38f57ba-7795-4f0e-8b45-37c658201fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d06f58-8b65-4a6a-b91b-65764d298d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72d06f58-8b65-4a6a-b91b-65764d298d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1430668599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:03Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fee7a6-b819-46e2-a08f-f8754fbdb6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fee7a6-b819-46e2-a08f-f8754fbdb6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a8fbf4-3e4f-4a37-ab8f-562043c943e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a8fbf4-3e4f-4a37-ab8f-562043c943e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda', 'volume_name': 'volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b155caf7-522f-4a50-a7df-83e1926943ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b155caf7-522f-4a50-a7df-83e1926943ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26306884-03a5-4953-9744-40a6ba236173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:02 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Volume 6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda', 'volume_size': 1} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1430668599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:03Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Creating volume 6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:02 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:02 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda 1073741824 Nov 01 09:54:02 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (dd906d9e-2985-450b-b7e8-b56e5754a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0aa46e-9a04-4b44-86e4-90c0bbdbc4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0aa46e-9a04-4b44-86e4-90c0bbdbc4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-904356377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b9ab4c-d787-465d-9792-a6c2852d962b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:03Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c3a2ea-5254-43f4-baa6-46ac21b44ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2c3a2ea-5254-43f4-baa6-46ac21b44ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e361b53-54b1-4b6a-9d15-5bdeb8443344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e361b53-54b1-4b6a-9d15-5bdeb8443344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b9ab4c-d787-465d-9792-a6c2852d962b', 'volume_name': 'volume-c0b9ab4c-d787-465d-9792-a6c2852d962b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62af4b75-7253-44cd-8472-850f51e36ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62af4b75-7253-44cd-8472-850f51e36ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4287f9d8-8cb0-4a2f-9de1-40876090c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume c0b9ab4c-d787-465d-9792-a6c2852d962b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b9ab4c-d787-465d-9792-a6c2852d962b', 'volume_size': 1} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (88671661-5b14-424f-aab2-a45ac9ed145f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb82db2-236b-47f5-acff-14673d96c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb82db2-236b-47f5-acff-14673d96c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-917120600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2112de-c9b6-46ed-9e53-261f90871262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:03Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db682db-7739-4001-a485-98276521690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db682db-7739-4001-a485-98276521690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568033d4-396f-4213-85b2-55047aa2930d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568033d4-396f-4213-85b2-55047aa2930d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2112de-c9b6-46ed-9e53-261f90871262', 'volume_name': 'volume-5a2112de-c9b6-46ed-9e53-261f90871262', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce51435-bb31-44b9-9622-148a30b618fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cce51435-bb31-44b9-9622-148a30b618fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c8611f-1ea9-4249-abe2-b2038acc0611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Volume 5a2112de-c9b6-46ed-9e53-261f90871262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2112de-c9b6-46ed-9e53-261f90871262', 'volume_size': 1} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (92484f67-23c5-4c69-a614-8d053a6fdbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39a9da2-db83-4672-9d59-c74ee05797dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39a9da2-db83-4672-9d59-c74ee05797dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-382302139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0f4745-1271-4664-8fc8-76e5d4a75b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:03Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8367ad04-5c55-4013-9a54-76ce7dcf036e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8367ad04-5c55-4013-9a54-76ce7dcf036e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5688cfe0-5f76-48bd-b34b-37476bafd370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5688cfe0-5f76-48bd-b34b-37476bafd370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0f4745-1271-4664-8fc8-76e5d4a75b82', 'volume_name': 'volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f2ed4a-ecb3-4ac2-9592-e38734c9d453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f2ed4a-ecb3-4ac2-9592-e38734c9d453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3bd4cc-139c-4a10-af37-0ecd053dd331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:03 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Volume 3f0f4745-1271-4664-8fc8-76e5d4a75b82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82', 'volume_size': 1} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda 1073741824" returned: 0 in 0.784s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:03 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda Nov 01 09:54:03 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:04 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda" returned: 0 in 0.400s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-904356377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b9ab4c-d787-465d-9792-a6c2852d962b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:03Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Creating volume c0b9ab4c-d787-465d-9792-a6c2852d962b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:04 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:04 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b 1073741824 Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26306884-03a5-4953-9744-40a6ba236173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7553d25-07e3-44ba-9caf-8edadeca4e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Volume volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda (6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda): created successfully Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7553d25-07e3-44ba-9caf-8edadeca4e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (f38f57ba-7795-4f0e-8b45-37c658201fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (ec5d04f7-c55b-4f64-8304-962d9c67c75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f489e4-ac26-4501-976a-cd82e2ee36c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2a8d3712-5b2c-4954-bc41-f19291888ecc tempest-CreateVolumesFromImageTest-143241804 None] Created volume successfully. Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f489e4-ac26-4501-976a-cd82e2ee36c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1008954717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbc8e76-3766-4c2b-be1a-37f34c031bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:04Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0a1473-dc82-4e47-8e2b-c17ed07b68a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0a1473-dc82-4e47-8e2b-c17ed07b68a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0079323-0095-495c-8db1-29313c96639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0079323-0095-495c-8db1-29313c96639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbc8e76-3766-4c2b-be1a-37f34c031bc1', 'volume_name': 'volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0afc3d2-662b-4ef5-b6d8-83d2c2349f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0afc3d2-662b-4ef5-b6d8-83d2c2349f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dff4ba-1094-4c90-a67d-ff570a887ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Volume 3bbc8e76-3766-4c2b-be1a-37f34c031bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1', 'volume_size': 1} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (2532f5d0-ba21-4838-b5be-71a074f2bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413c0340-8d88-4004-8948-73af4f0caed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413c0340-8d88-4004-8948-73af4f0caed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908311379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631dc508-7022-4292-b44d-8723305e1c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:04Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979422c6-b277-47bd-9926-8990403faaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979422c6-b277-47bd-9926-8990403faaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d29765a-a4cb-42e2-8b14-f86a79c2b910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d29765a-a4cb-42e2-8b14-f86a79c2b910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631dc508-7022-4292-b44d-8723305e1c93', 'volume_name': 'volume-631dc508-7022-4292-b44d-8723305e1c93', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343662f6-0d22-400c-9d2b-1faf6ba2ff78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343662f6-0d22-400c-9d2b-1faf6ba2ff78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6701806-7257-4090-9844-61809a561d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Volume 631dc508-7022-4292-b44d-8723305e1c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631dc508-7022-4292-b44d-8723305e1c93', 'volume_size': 1} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (7c30d439-b71e-49c6-b13e-f2686dfe8dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6289455e-9492-4d82-a111-8f2535ea53d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6289455e-9492-4d82-a111-8f2535ea53d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-379641363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d8ab0b-3532-42cb-8cc4-c376aa0c5112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:04Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aedea39-0f29-45a8-9760-2c59990e1fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aedea39-0f29-45a8-9760-2c59990e1fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cacc7a-0659-4119-a981-6d0eda79ce79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cacc7a-0659-4119-a981-6d0eda79ce79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29d8ab0b-3532-42cb-8cc4-c376aa0c5112', 'volume_name': 'volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bdd8a2-8530-461d-9545-7d874eae46f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62bdd8a2-8530-461d-9545-7d874eae46f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11415aa1-f970-434f-9efe-e9fa159b1dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:04 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Volume 29d8ab0b-3532-42cb-8cc4-c376aa0c5112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112', 'volume_size': 1} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b 1073741824" returned: 0 in 0.603s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:04 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b Nov 01 09:54:04 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:04 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b" returned: 0 in 0.257s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-917120600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2112de-c9b6-46ed-9e53-261f90871262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:03Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Creating volume 5a2112de-c9b6-46ed-9e53-261f90871262 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:04 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4287f9d8-8cb0-4a2f-9de1-40876090c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b9ab4c-d787-465d-9792-a6c2852d962b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5506ea-dafa-4326-907e-91d4d5e589b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:05 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 1073741824 Nov 01 09:54:05 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:05 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume volume-c0b9ab4c-d787-465d-9792-a6c2852d962b (c0b9ab4c-d787-465d-9792-a6c2852d962b): created successfully Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a5506ea-dafa-4326-907e-91d4d5e589b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (dd906d9e-2985-450b-b7e8-b56e5754a802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:05 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6693a565-7597-4a7d-be92-f5ca02381e1b tempest-CreateVolumesFromSnapshotTest-681756397 None] Created volume successfully. Nov 01 09:54:05 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 1073741824" returned: 0 in 0.489s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:05 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 Nov 01 09:54:05 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:05 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262" returned: 0 in 0.245s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.176s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-382302139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0f4745-1271-4664-8fc8-76e5d4a75b82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:03Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Creating volume 3f0f4745-1271-4664-8fc8-76e5d4a75b82 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:05 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c8611f-1ea9-4249-abe2-b2038acc0611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2112de-c9b6-46ed-9e53-261f90871262', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:05 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 1073741824 Nov 01 09:54:05 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac072d1-5e7b-4b06-80a4-0698dfdc2d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:05 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Volume volume-5a2112de-c9b6-46ed-9e53-261f90871262 (5a2112de-c9b6-46ed-9e53-261f90871262): created successfully Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac072d1-5e7b-4b06-80a4-0698dfdc2d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (88671661-5b14-424f-aab2-a45ac9ed145f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:05 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f10fe6d3-a0ae-495a-9ac9-4aebcab1817a tempest-CreateVolumesFromImageTest-143241804 None] Created volume successfully. Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:06 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 1073741824" returned: 0 in 0.532s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:06 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 Nov 01 09:54:06 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:06 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82" returned: 0 in 0.269s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1008954717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbc8e76-3766-4c2b-be1a-37f34c031bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:04Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Creating volume 3bbc8e76-3766-4c2b-be1a-37f34c031bc1 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:06 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:06 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 1073741824 Nov 01 09:54:06 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3bd4cc-139c-4a10-af37-0ecd053dd331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9197444-1f08-404e-bf26-e844e0cce900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:06 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Volume volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 (3f0f4745-1271-4664-8fc8-76e5d4a75b82): created successfully Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9197444-1f08-404e-bf26-e844e0cce900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (92484f67-23c5-4c69-a614-8d053a6fdbc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bfa37b7c-0e84-4d2a-9970-7b8cc895fe79 tempest-CreateVolumesFromImageTest-143241804 None] Created volume successfully. Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Flow 'volume_create_manager' (04a9d647-c487-4214-bbac-5e391ddca81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:06 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df53976-2357-4136-acf1-99043b916a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df53976-2357-4136-acf1-99043b916a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55b408255664060b0c943ea635c03de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:07Z,use_quota=True,user_id='ba708ee4860c446db11e87709ea909da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4580421c-78a9-4671-a839-f36ae9f1d05a),volume_type_id=4580421c-78a9-4671-a839-f36ae9f1d05a)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c69f0ab-77d7-485c-806c-68e4d9f9affe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c69f0ab-77d7-485c-806c-68e4d9f9affe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa349ffc-d251-4e2b-9f72-ea4083471ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:54:07 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 1073741824" returned: 0 in 0.473s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:07 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 Nov 01 09:54:07 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa349ffc-d251-4e2b-9f72-ea4083471ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee', 'volume_name': 'volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee', 'volume_size': 1, 'image_id': 'ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdb1ccb070855b461689c268a3c419fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b55b408255664060b0c943ea635c03de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1eba84d11af3dd2e1a165b1bf34c7696c626515186b85bb966ebec6349a778dc901ad6b5e8d444f0878578f5f68101f9a4b6113b7d3afe5968b5ea9111867a7c', 'id': 'ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'created_at': datetime.datetime(2026, 11, 1, 8, 54, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f6a9cd-3314-45d1-9091-15597f2f8182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f6a9cd-3314-45d1-9091-15597f2f8182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb5baa6-f9b5-48dd-bfa8-8d265fccceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:07 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Volume 3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee', 'volume_size': 1, 'image_id': 'ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdb1ccb070855b461689c268a3c419fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b55b408255664060b0c943ea635c03de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1eba84d11af3dd2e1a165b1bf34c7696c626515186b85bb966ebec6349a778dc901ad6b5e8d444f0878578f5f68101f9a4b6113b7d3afe5968b5ea9111867a7c', 'id': 'ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'created_at': datetime.datetime(2026, 11, 1, 8, 54, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Trying to clone 3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee from image ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:54:07 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1" returned: 0 in 0.258s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.833s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-908311379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631dc508-7022-4292-b44d-8723305e1c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:04Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Creating volume 631dc508-7022-4292-b44d-8723305e1c93 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:07 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61dff4ba-1094-4c90-a67d-ff570a887ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:07 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 1073741824 Nov 01 09:54:07 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824a828d-879b-403f-b864-4d26252b0020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:07 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Volume volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 (3bbc8e76-3766-4c2b-be1a-37f34c031bc1): created successfully Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (824a828d-879b-403f-b864-4d26252b0020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (ec5d04f7-c55b-4f64-8304-962d9c67c75d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:54:07 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Image download 0.00 MB at 0.00 MB/s Nov 01 09:54:07 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b45a520b-d4c2-476a-bb3f-2b3404c01cfc tempest-CreateVolumesFromImageTest-143241804 None] Created volume successfully. Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0991ce3a-bdb3-4cb3-9699-3beb618a5301]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:07 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD Nov 01 09:54:07 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:07 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 1073741824" returned: 0 in 0.474s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:07 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:07 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 Nov 01 09:54:07 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:08 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD Nov 01 09:54:08 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:08 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.516s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-379641363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29d8ab0b-3532-42cb-8cc4-c376aa0c5112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39affee5322c4de99f24e404372f341a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:04Z,use_quota=True,user_id='e3488420cdb440ef8947a0e6b60bbae0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Creating volume 29d8ab0b-3532-42cb-8cc4-c376aa0c5112 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:08 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6701806-7257-4090-9844-61809a561d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631dc508-7022-4292-b44d-8723305e1c93', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354443eb-e729-437f-b4a8-ad79a0eac289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:08 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 1073741824 Nov 01 09:54:08 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:08 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Volume volume-631dc508-7022-4292-b44d-8723305e1c93 (631dc508-7022-4292-b44d-8723305e1c93): created successfully Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354443eb-e729-437f-b4a8-ad79a0eac289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (2532f5d0-ba21-4838-b5be-71a074f2bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:08 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ddd5a970-0115-49a0-b395-d938f964487b tempest-ProjectReaderTests-1292665826 None] Created volume successfully. Nov 01 09:54:08 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Temporary image ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5 is fetched for user ba708ee4860c446db11e87709ea909da. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5a252-3250-4791-8dd7-724dbb7cb782]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:08 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD Nov 01 09:54:08 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:08 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 1073741824" returned: 0 in 0.433s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:08 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 Nov 01 09:54:08 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:08 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:08 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD Nov 01 09:54:08 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:08 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112" returned: 0 in 0.271s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.759s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11415aa1-f970-434f-9efe-e9fa159b1dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adba494b-96ad-4813-9237-76ec7fb9ba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Creating offline snapshot a0a59c11-2544-425e-a8e3-88a8942264cb of volume c0b9ab4c-d787-465d-9792-a6c2852d962b {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:54:08 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Volume volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 (29d8ab0b-3532-42cb-8cc4-c376aa0c5112): created successfully Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adba494b-96ad-4813-9237-76ec7fb9ba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Flow 'volume_create_manager' (7c30d439-b71e-49c6-b13e-f2686dfe8dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0da16b-3c4b-453f-addd-662b6d0a792e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-526eefb3-6451-4450-9a45-0500de75b189 tempest-CreateVolumesFromImageTest-143241804 None] Created volume successfully. Nov 01 09:54:09 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:09 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b Nov 01 09:54:09 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:09 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b" returned: 0 in 0.383s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:09 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb 1G Nov 01 09:54:09 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:09 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb 1G" returned: 0 in 0.401s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b9ab4c-d787-465d-9792-a6c2852d962b -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:09 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b9ab4c-d787-465d-9792-a6c2852d962b -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb Nov 01 09:54:09 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-29d8ab0b-3532-42cb-8cc4-c376aa0c5112-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-29d8ab0b-3532-42cb-8cc4-c376aa0c5112-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-quobyte-29d8ab0b-3532-42cb-8cc4-c376aa0c5112" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-29d8ab0b-3532-42cb-8cc4-c376aa0c5112" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5356a2-2e44-4c3a-8ebe-cc1fd018996a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:10 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b9ab4c-d787-465d-9792-a6c2852d962b -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb" returned: 0 in 0.306s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:10 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb is being set with open permissions: ugo+rw Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:10 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb Nov 01 09:54:10 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:10 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 Nov 01 09:54:10 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:10 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb" returned: 0 in 0.262s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:10 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112" returned: 0 in 0.389s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:10 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.info Nov 01 09:54:10 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:10 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112 Nov 01 09:54:10 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:10 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.info" returned: 0 in 0.253s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:10 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.info is being set with open permissions: ugo+rw Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:10 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-29d8ab0b-3532-42cb-8cc4-c376aa0c5112" returned: 0 in 0.254s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:10 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.info Nov 01 09:54:10 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-29d8ab0b-3532-42cb-8cc4-c376aa0c5112" released by "delete_volume" :: held 0.697s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Created reservations ['9cc5f1c6-afb3-4b45-9e7d-03d6f957b4c4', '792c3e0a-54da-415f-8077-c43b283b9f2e', 'eb1f9c8d-2aa9-4c47-9ede-68ae54d6a157', 'c3953924-a00a-4b38-a265-0aa40a710d5f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:10 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:10 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:10 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.info" returned: 0 in 0.249s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b55b408255664060b0c943ea635c03de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:07Z,use_quota=True,user_id='ba708ee4860c446db11e87709ea909da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4580421c-78a9-4671-a839-f36ae9f1d05a),volume_type_id=4580421c-78a9-4671-a839-f36ae9f1d05a)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Creating volume 3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:10 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:10 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee 1073741824 Nov 01 09:54:10 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-22a7443e-26a8-43b7-a888-2a6a445c2d16 tempest-CreateVolumesFromSnapshotTest-681756397 None] Create snapshot completed successfully Nov 01 09:54:11 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.294s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-3bbc8e76-3766-4c2b-be1a-37f34c031bc1-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:11 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Deleted volume successfully. Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-3bbc8e76-3766-4c2b-be1a-37f34c031bc1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-16f808c3-c9f0-4113-9b5a-04954436fb3d tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-29d8ab0b-3532-42cb-8cc4-c376aa0c5112-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-quobyte-3bbc8e76-3766-4c2b-be1a-37f34c031bc1" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-3bbc8e76-3766-4c2b-be1a-37f34c031bc1" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d5963-e66a-4b1f-badb-e8f015926fee]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:11 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 Nov 01 09:54:11 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:11 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee 1073741824" returned: 0 in 0.531s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:11 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee Nov 01 09:54:11 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:11 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1" returned: 0 in 0.405s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:11 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1 Nov 01 09:54:11 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:11 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee" returned: 0 in 0.289s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.362s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Creating offline snapshot f548424c-0bfc-48eb-8bac-d01e1aa34eaf of volume 631dc508-7022-4292-b44d-8723305e1c93 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Attempting download of ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'metadata': {}}])) to volume 3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf4043-e44f-4197-9cc7-a19db507d97d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf2bf07-18ab-4bbc-81a2-acf388ce5872]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_hwhtkxfi {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:11 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3bbc8e76-3766-4c2b-be1a-37f34c031bc1" returned: 0 in 0.331s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:11 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-3bbc8e76-3766-4c2b-be1a-37f34c031bc1" released by "delete_volume" :: held 0.785s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (6bbe1db7-2c1f-40ff-b6a6-344cb3002ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:12 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 Nov 01 09:54:12 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7634ee1-982d-43ac-879f-0dd7e9eb25b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_hwhtkxfi Nov 01 09:54:12 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7634ee1-982d-43ac-879f-0dd7e9eb25b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-433113726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3461b1-d384-4d2b-89f8-cc0aa8e0957e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:12Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fad1382-57d0-4f0a-9c48-c5ea59b4fbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fad1382-57d0-4f0a-9c48-c5ea59b4fbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e365ad1-4362-4b29-9ce6-978d38a96e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e365ad1-4362-4b29-9ce6-978d38a96e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3461b1-d384-4d2b-89f8-cc0aa8e0957e', 'volume_name': 'volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3adee4-a431-4f1d-b79f-bfbd044b1fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3adee4-a431-4f1d-b79f-bfbd044b1fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05a2867-df0a-45d5-9751-797e96ff09c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume ed3461b1-d384-4d2b-89f8-cc0aa8e0957e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e', 'volume_size': 1} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Created reservations ['d03bfd5c-035c-4c5e-9e7d-c1004372ea15', 'd7c844b2-e1d7-417a-857e-d120e8297641', '23b9829c-ec69-4d8b-a798-604bde97f91a', '98e6060e-3563-4f0d-aba2-2d94c0e3b173'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:12 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:12 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-3f0f4745-1271-4664-8fc8-76e5d4a75b82-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:12 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93" returned: 0 in 0.581s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:12 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:12 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf 1G Nov 01 09:54:12 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_hwhtkxfi" returned: 0 in 0.592s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_hwhtkxfi {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-3f0f4745-1271-4664-8fc8-76e5d4a75b82-delete_volume" acquired by "delete_volume" :: waited 0.138s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (def1a567-efad-44c7-bd65-3f34383cb321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df92074-b837-4958-b130-9c3694ecda8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6df92074-b837-4958-b130-9c3694ecda8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970554686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd78d7b7-146a-4fe8-a27a-374f463b2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:12Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eba5c5a-1171-4780-b2ae-33702c7942f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eba5c5a-1171-4780-b2ae-33702c7942f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc006321-aa75-4884-983f-11d3dc4e0428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc006321-aa75-4884-983f-11d3dc4e0428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd78d7b7-146a-4fe8-a27a-374f463b2af9', 'volume_name': 'volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a19136b-d561-4f49-9796-b4bc14463527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a19136b-d561-4f49-9796-b4bc14463527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3243af12-ea80-49e4-b390-a98a982171c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:12 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume dd78d7b7-146a-4fe8-a27a-374f463b2af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9', 'volume_size': 1} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-quobyte-3f0f4745-1271-4664-8fc8-76e5d4a75b82" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:12 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_hwhtkxfi Nov 01 09:54:12 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-3f0f4745-1271-4664-8fc8-76e5d4a75b82" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:12 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.462s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f204ee-8db8-4a89-9f5a-80a6fdc5cad7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:12 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Deleted volume successfully. Nov 01 09:54:12 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-af54b80d-5800-4db3-bfa1-40c650b05e2b tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-3bbc8e76-3766-4c2b-be1a-37f34c031bc1-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:12 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 Nov 01 09:54:12 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (4c0f9f7f-aaa4-4c89-a1f7-d168a95e03f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b683e157-3b88-4bbc-94d5-d7b86094e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b683e157-3b88-4bbc-94d5-d7b86094e878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-869240653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219caf05-9f54-4dcb-ba10-25a846a568c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:13Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f6a226-9030-401e-8c53-2292b7daa0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f6a226-9030-401e-8c53-2292b7daa0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf68d6f0-713b-4549-b37d-5b5fe16327aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf68d6f0-713b-4549-b37d-5b5fe16327aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219caf05-9f54-4dcb-ba10-25a846a568c7', 'volume_name': 'volume-219caf05-9f54-4dcb-ba10-25a846a568c7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023808f9-d56d-40a6-a945-5102f9233ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023808f9-d56d-40a6-a945-5102f9233ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0958711c-ab2e-49d3-a23d-77a2752f21ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume 219caf05-9f54-4dcb-ba10-25a846a568c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219caf05-9f54-4dcb-ba10-25a846a568c7', 'volume_size': 1} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_hwhtkxfi" returned: 1 in 0.577s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_hwhtkxfi' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b9b3ac-4aa7-41f9-987e-aeffdaa27e1f]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:13 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf 1G" returned: 0 in 0.686s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631dc508-7022-4292-b44d-8723305e1c93 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:13 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631dc508-7022-4292-b44d-8723305e1c93 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf Nov 01 09:54:13 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:13 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD Nov 01 09:54:13 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:13 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82" returned: 0 in 0.556s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:13 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82 Nov 01 09:54:13 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (18412332-884d-4d74-a181-cba987a950b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5aa94e-8946-4bea-b312-5846e68c349f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5aa94e-8946-4bea-b312-5846e68c349f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-166515762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b88b22-3428-4f47-ba55-030214d86e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:13Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d47c9e-3ff5-42e4-bcbf-0b27a05f109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d47c9e-3ff5-42e4-bcbf-0b27a05f109e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d914dd-e7c0-428d-b60a-e633201a812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d914dd-e7c0-428d-b60a-e633201a812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b88b22-3428-4f47-ba55-030214d86e45', 'volume_name': 'volume-f9b88b22-3428-4f47-ba55-030214d86e45', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f02f2e2-a0d5-4cb4-bf15-5ec930de32d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f02f2e2-a0d5-4cb4-bf15-5ec930de32d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c089cda-56db-487f-a3c7-f4db62783cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume f9b88b22-3428-4f47-ba55-030214d86e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b88b22-3428-4f47-ba55-030214d86e45', 'volume_size': 1} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:13 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-631dc508-7022-4292-b44d-8723305e1c93 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf" returned: 0 in 0.428s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:13 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf is being set with open permissions: ugo+rw Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:13 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:13 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf Nov 01 09:54:13 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:13 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD Nov 01 09:54:13 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:13 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3f0f4745-1271-4664-8fc8-76e5d4a75b82" returned: 0 in 0.388s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-3f0f4745-1271-4664-8fc8-76e5d4a75b82" released by "delete_volume" :: held 1.028s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Created reservations ['038de891-7ce3-4a52-9d88-303dbcfaa17e', 'df965cb0-dfbd-44ca-bc75-d9c0637260e8', 'bd8f652b-7acc-47b4-be8e-1dad562dd493', '38dbd406-55a6-4e30-9c62-6e78256f60b6'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:13 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf" returned: 0 in 0.365s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:14 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:14 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:14 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5 was raw, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:54:14 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.info Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:14 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:14 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:14 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (0d43766e-64b9-48a9-90cf-db4d6a489c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b196c320-8724-4019-807a-9378da591c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b196c320-8724-4019-807a-9378da591c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374280223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8137a140-02a3-4c0e-9c62-ea729e44f8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:14Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5608e670-ba5e-4597-9e69-56d6264c552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5608e670-ba5e-4597-9e69-56d6264c552f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854a5a10-6306-4cb4-b7f4-ca2af2afc986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (854a5a10-6306-4cb4-b7f4-ca2af2afc986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8137a140-02a3-4c0e-9c62-ea729e44f8f1', 'volume_name': 'volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1299d2ff-6418-47c9-a14d-e051ec539778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1299d2ff-6418-47c9-a14d-e051ec539778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04db669-7021-45a2-89f2-586a69a56d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:14 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume 8137a140-02a3-4c0e-9c62-ea729e44f8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1', 'volume_size': 1} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:14 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.271s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Deleted volume successfully. Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c4924e6e-2cf7-4b4b-af34-6ae0b09fdef3 tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-3f0f4745-1271-4664-8fc8-76e5d4a75b82-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:14 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.info" returned: 0 in 0.306s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:14 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.info is being set with open permissions: ugo+rw Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:14 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.info Nov 01 09:54:14 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:14 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee" returned: 0 in 0.524s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5_7iegfaigdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:54:14 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:14 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.info" returned: 0 in 0.283s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:14 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee 1G Nov 01 09:54:14 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.484s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-433113726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3461b1-d384-4d2b-89f8-cc0aa8e0957e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:12Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Creating volume ed3461b1-d384-4d2b-89f8-cc0aa8e0957e {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:14 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:14 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e 1073741824 Nov 01 09:54:14 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7f38564b-d295-46e9-8f5e-3eb6815cb8b2 tempest-ProjectReaderTests-1292665826 None] Create snapshot completed successfully Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-5a2112de-c9b6-46ed-9e53-261f90871262-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-5a2112de-c9b6-46ed-9e53-261f90871262-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-quobyte-5a2112de-c9b6-46ed-9e53-261f90871262" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-5a2112de-c9b6-46ed-9e53-261f90871262" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f9d3f1-15e0-4647-a77d-33d1f325c2e0]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-f548424c-0bfc-48eb-8bac-d01e1aa34eaf-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:15 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee 1G" returned: 0 in 0.456s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Downloaded image ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'metadata': {}}])) to volume 3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Temporary image ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5 for user ba708ee4860c446db11e87709ea909da is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Marking volume 3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-f548424c-0bfc-48eb-8bac-d01e1aa34eaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-631dc508-7022-4292-b44d-8723305e1c93" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Copying metadata from image ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5 to 3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Creating volume glance metadata for volume 3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee backed by image ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cdb1ccb070855b461689c268a3c419fa', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-631dc508-7022-4292-b44d-8723305e1c93" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-f548424c-0bfc-48eb-8bac-d01e1aa34eaf" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:15 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 Nov 01 09:54:15 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-f548424c-0bfc-48eb-8bac-d01e1aa34eaf" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Deleting offline snapshot f548424c-0bfc-48eb-8bac-d01e1aa34eaf of volume 631dc508-7022-4292-b44d-8723305e1c93 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] snapshot_file for this snap is: volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bad2a8-e4f0-4bc3-9f5b-3bdbc997ac49]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb5baa6-f9b5-48dd-bfa8-8d265fccceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee', 'volume_size': 1, 'image_id': 'ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cdb1ccb070855b461689c268a3c419fa', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b55b408255664060b0c943ea635c03de', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1eba84d11af3dd2e1a165b1bf34c7696c626515186b85bb966ebec6349a778dc901ad6b5e8d444f0878578f5f68101f9a4b6113b7d3afe5968b5ea9111867a7c', 'id': 'ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5', 'created_at': datetime.datetime(2026, 11, 1, 8, 54, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 54, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec13d3f1-e2c5-4e1a-8ec1-ce559bc690e5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5fc10e-aed9-42d5-99f9-2f78e6a4fa19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:15 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Volume volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee (3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee): created successfully Nov 01 09:54:15 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f5fc10e-aed9-42d5-99f9-2f78e6a4fa19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Flow 'volume_create_manager' (04a9d647-c487-4214-bbac-5e391ddca81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e 1073741824" returned: 0 in 0.602s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-87adf426-8c28-47be-8eef-3f4c3b8c50e0 tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Created volume successfully. Nov 01 09:54:15 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf Nov 01 09:54:15 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:15 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e Nov 01 09:54:15 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:15 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262" returned: 0 in 0.483s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:15 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262 Nov 01 09:54:15 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Acquiring lock "cinder-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:15 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf" returned: 0 in 0.445s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-631dc508-7022-4292-b44d-8723305e1c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "cinder-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:15 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52dcfc8-3611-4908-8391-0d060754d190]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e" returned: 0 in 0.370s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.928s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970554686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd78d7b7-146a-4fe8-a27a-374f463b2af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:12Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Creating volume dd78d7b7-146a-4fe8-a27a-374f463b2af9 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:15 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05a2867-df0a-45d5-9751-797e96ff09c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa1bd87-697b-46ea-b8c9-18b5392fef58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:15 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 1073741824 Nov 01 09:54:15 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Acquiring lock "cinder-quobyte-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:15 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e (ed3461b1-d384-4d2b-89f8-cc0aa8e0957e): created successfully Nov 01 09:54:15 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 Nov 01 09:54:15 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa1bd87-697b-46ea-b8c9-18b5392fef58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:15 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (6bbe1db7-2c1f-40ff-b6a6-344cb3002ab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5a2112de-c9b6-46ed-9e53-261f90871262" returned: 0 in 0.376s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "cinder-quobyte-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee" acquired by "delete_volume" :: waited 0.057s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9574bcd3-fbf5-4d7d-90f0-375141a4cb50 tempest-CreateVolumesFromSnapshotTest-681756397 None] Created volume successfully. Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-5a2112de-c9b6-46ed-9e53-261f90871262" released by "delete_volume" :: held 0.930s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d23145-815d-4acb-9a75-b6b19eee790e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Created reservations ['c0cb477b-19d5-4606-8d21-be00a8a16104', 'f88f2a57-8238-4322-912c-07d87e262042', '369fe05b-bc1f-4b47-8f4f-126bdc44cc36', '299a25f7-0b5e-4270-be07-0cc43b3cbce7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:15 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:15 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:16 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee Nov 01 09:54:16 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:16 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93" returned: 0 in 0.528s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:16 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf Nov 01 09:54:16 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:16 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 1073741824" returned: 0 in 0.602s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:16 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.325s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Deleted volume successfully. Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ade8a989-d2fd-462b-811d-055f024bdfab tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-5a2112de-c9b6-46ed-9e53-261f90871262-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:16 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 Nov 01 09:54:16 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:16 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee" returned: 0 in 0.558s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:16 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee Nov 01 09:54:16 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:16 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf" returned: 0 in 0.375s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:16 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf Nov 01 09:54:16 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:16 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9" returned: 0 in 0.271s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.473s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-869240653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219caf05-9f54-4dcb-ba10-25a846a568c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:13Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Creating volume 219caf05-9f54-4dcb-ba10-25a846a568c7 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:16 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:16 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 1073741824 Nov 01 09:54:16 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3243af12-ea80-49e4-b390-a98a982171c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e6ffab-b68d-4694-abbf-2dd757c32f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:16 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 (dd78d7b7-146a-4fe8-a27a-374f463b2af9): created successfully Nov 01 09:54:16 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e6ffab-b68d-4694-abbf-2dd757c32f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (def1a567-efad-44c7-bd65-3f34383cb321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee" returned: 0 in 0.320s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "cinder-quobyte-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee" released by "delete_volume" :: held 0.935s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5126ede5-e289-4ade-81ac-c91825c6f7fb tempest-CreateVolumesFromSnapshotTest-681756397 None] Created volume successfully. Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Created reservations ['3f4e22d2-00a8-4622-a4d8-82edb4df852a', '24a2a03b-8072-4ee8-826a-82ac115762e8', '4db5ebb8-f427-40e1-b811-89c1db6cb5b8', '0f01f3b1-18aa-4e76-85b2-0573215c54ff'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:16 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93.f548424c-0bfc-48eb-8bac-d01e1aa34eaf" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-f548424c-0bfc-48eb-8bac-d01e1aa34eaf" released by "_delete_snapshot" :: held 1.738s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-631dc508-7022-4292-b44d-8723305e1c93" released by "delete_snapshot" :: held 1.776s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:16 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:16 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:16 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Created reservations ['5d2c2332-56c5-4bb3-b9ec-7af232eb694d', '7e36d0a2-5786-400b-bdba-1e457bf8b504', '9d576520-06d0-4b83-8e31-859eef5984e0', '8a30ca36-4a06-43c1-a15a-dac8ec82e056'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Delete snapshot completed successfully. Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f722af71-68be-4e0d-a2f9-678233f4eb09 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-f548424c-0bfc-48eb-8bac-d01e1aa34eaf-delete_snapshot" released by "delete_snapshot" :: held 1.972s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:17 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 1073741824" returned: 0 in 0.574s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "cinder-quobyte-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda" acquired by "delete_volume" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:17 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-631dc508-7022-4292-b44d-8723305e1c93-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.382s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b6e1f-6a9e-4617-8d14-40c80c57fc5d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:17 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 Nov 01 09:54:17 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Deleted volume successfully. Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-631dc508-7022-4292-b44d-8723305e1c93-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf46fddf-66da-42bf-99f5-b4335945f89d tempest-VolumeAndVolumeTypeFromImageTest-824024803 None] Lock "cinder-3c13fbfa-cf8a-42d9-bf52-ba8b34e802ee-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-631dc508-7022-4292-b44d-8723305e1c93" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-631dc508-7022-4292-b44d-8723305e1c93" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ba6f17-1db9-4fc9-b61e-0af83096cdf1]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:17 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:17 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:17 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 Nov 01 09:54:17 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:17 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7" returned: 0 in 0.330s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.025s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-166515762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b88b22-3428-4f47-ba55-030214d86e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:13Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Creating volume f9b88b22-3428-4f47-ba55-030214d86e45 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:17 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0958711c-ab2e-49d3-a23d-77a2752f21ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219caf05-9f54-4dcb-ba10-25a846a568c7', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:17 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 1073741824 Nov 01 09:54:17 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3977bfc4-f135-4803-98ec-b70b71ce8862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:17 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume volume-219caf05-9f54-4dcb-ba10-25a846a568c7 (219caf05-9f54-4dcb-ba10-25a846a568c7): created successfully Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3977bfc4-f135-4803-98ec-b70b71ce8862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (4c0f9f7f-aaa4-4c89-a1f7-d168a95e03f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b966a58f-b727-474b-8304-d03e6e378b63 tempest-CreateVolumesFromSnapshotTest-681756397 None] Created volume successfully. Nov 01 09:54:17 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda" returned: 0 in 0.436s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:17 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda Nov 01 09:54:17 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:17 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93" returned: 0 in 0.406s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:17 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93 Nov 01 09:54:17 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:18 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda" returned: 0 in 0.329s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-quobyte-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda" released by "delete_volume" :: held 0.859s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Created reservations ['759f5820-d1bd-4985-86fc-1801e7318599', 'ec2d1f01-03ae-4b5d-a1bb-50c4c2dabe13', 'f47429e7-0e00-4812-b9db-535317e49658', 'b78cf397-c2cf-453a-9379-6549444a1c7d'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:18 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-631dc508-7022-4292-b44d-8723305e1c93" returned: 0 in 0.334s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:18 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 1073741824" returned: 0 in 0.596s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-631dc508-7022-4292-b44d-8723305e1c93" released by "delete_volume" :: held 0.828s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:18 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 Nov 01 09:54:18 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Created reservations ['b8a1903d-ac2a-474c-989d-6be289f2fab5', '6ed36ec8-981e-44a8-8d35-bf47c0448890', '478dcfaf-9652-4890-aa19-6ffbfc412f89', '9860f5b6-f6c6-49a9-9b17-0e320f12e59e'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:18 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:18 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:18 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:18 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:18 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45" returned: 0 in 0.465s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.569s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1374280223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8137a140-02a3-4c0e-9c62-ea729e44f8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94cc15d43b14a4db1eb3bb84aad7380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:14Z,use_quota=True,user_id='a416dfe56a974b08bb92128bf6757657',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Creating volume 8137a140-02a3-4c0e-9c62-ea729e44f8f1 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:18 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:18 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c089cda-56db-487f-a3c7-f4db62783cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b88b22-3428-4f47-ba55-030214d86e45', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:18 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 1073741824 Nov 01 09:54:18 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0befc0ef-d2b0-476e-92c7-4584575136e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.502s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Deleted volume successfully. Nov 01 09:54:18 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume volume-f9b88b22-3428-4f47-ba55-030214d86e45 (f9b88b22-3428-4f47-ba55-030214d86e45): created successfully Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0befc0ef-d2b0-476e-92c7-4584575136e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (18412332-884d-4d74-a181-cba987a950b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-639c9cba-0208-4c5f-a4cb-a34ae2af9206 tempest-CreateVolumesFromSnapshotTest-681756397 None] Created volume successfully. Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-077d1482-b329-48d5-acbb-355b120eb35d tempest-CreateVolumesFromImageTest-143241804 None] Lock "cinder-6bfa1e12-b9b0-48d1-8186-fe3db0bf1eda-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:18 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.429s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:18 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Deleted volume successfully. Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-39b3c9f0-ec20-4572-be02-cd14b521b325 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-631dc508-7022-4292-b44d-8723305e1c93-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (63f891fd-d030-4d3d-a6dd-15189ba2e5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b892ae-8801-4afd-b2f9-3d3809922d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b892ae-8801-4afd-b2f9-3d3809922d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9315778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a66e2b4-7033-4835-829c-77d9cfd185ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:19Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80db711-a841-4c96-950c-e439c55188f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c80db711-a841-4c96-950c-e439c55188f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e895a5b-d9c7-4b9d-98d5-50ae729ce489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e895a5b-d9c7-4b9d-98d5-50ae729ce489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a66e2b4-7033-4835-829c-77d9cfd185ef', 'volume_name': 'volume-7a66e2b4-7033-4835-829c-77d9cfd185ef', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812eae25-18b7-4bcc-8497-abac18bc38c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (812eae25-18b7-4bcc-8497-abac18bc38c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e2d800-44f3-4832-b0af-ae8ccbb4a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:19 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Volume 7a66e2b4-7033-4835-829c-77d9cfd185ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a66e2b4-7033-4835-829c-77d9cfd185ef', 'volume_size': 1} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:19 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 1073741824" returned: 0 in 0.543s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:19 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 Nov 01 09:54:19 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:19 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1" returned: 0 in 0.319s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9315778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a66e2b4-7033-4835-829c-77d9cfd185ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:19Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Creating volume 7a66e2b4-7033-4835-829c-77d9cfd185ef {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:19 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:19 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef 1073741824 Nov 01 09:54:19 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04db669-7021-45a2-89f2-586a69a56d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc91d18f-fc31-4bfe-bb8b-60870afd7863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:19 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Volume volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 (8137a140-02a3-4c0e-9c62-ea729e44f8f1): created successfully Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc91d18f-fc31-4bfe-bb8b-60870afd7863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:19 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Flow 'volume_create_manager' (0d43766e-64b9-48a9-90cf-db4d6a489c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-359446e9-b626-48e8-bbd5-12cddeffae12 tempest-CreateVolumesFromSnapshotTest-681756397 None] Created volume successfully. Nov 01 09:54:20 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef 1073741824" returned: 0 in 0.563s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:20 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef Nov 01 09:54:20 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:20 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef" returned: 0 in 0.276s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e2d800-44f3-4832-b0af-ae8ccbb4a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a66e2b4-7033-4835-829c-77d9cfd185ef', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ac51dd-c94a-4c09-84c1-836a27f53f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:20 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Volume volume-7a66e2b4-7033-4835-829c-77d9cfd185ef (7a66e2b4-7033-4835-829c-77d9cfd185ef): created successfully Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ac51dd-c94a-4c09-84c1-836a27f53f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (63f891fd-d030-4d3d-a6dd-15189ba2e5de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8732cc6c-399c-4ee2-9f50-2194d8ae5e0d tempest-ProjectReaderTests-1292665826 None] Created volume successfully. Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-8137a140-02a3-4c0e-9c62-ea729e44f8f1-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-8137a140-02a3-4c0e-9c62-ea729e44f8f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-quobyte-8137a140-02a3-4c0e-9c62-ea729e44f8f1" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-8137a140-02a3-4c0e-9c62-ea729e44f8f1" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[012257a5-3c75-481b-b711-485cdb82f2ba]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:21 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 Nov 01 09:54:21 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:21 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1" returned: 0 in 0.465s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:21 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1 Nov 01 09:54:21 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Creating offline snapshot 705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 of volume 7a66e2b4-7033-4835-829c-77d9cfd185ef {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6d88e-c526-4a2f-b965-95496c8feb77]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:21 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef Nov 01 09:54:21 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:21 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8137a140-02a3-4c0e-9c62-ea729e44f8f1" returned: 0 in 0.367s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-8137a140-02a3-4c0e-9c62-ea729e44f8f1" released by "delete_volume" :: held 0.909s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Created reservations ['b064827d-0009-46a4-8fd0-d223ca903325', '39a96a1c-83fe-4d67-99b9-563454e650e5', '68454a68-87f0-483e-94a7-92841434f70c', '733a204d-2e98-417f-aba2-7e4530b47795'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:22 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:22 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:22 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-f9b88b22-3428-4f47-ba55-030214d86e45-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef" returned: 0 in 0.532s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-f9b88b22-3428-4f47-ba55-030214d86e45-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:22 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 1G Nov 01 09:54:22 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-quobyte-f9b88b22-3428-4f47-ba55-030214d86e45" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-f9b88b22-3428-4f47-ba55-030214d86e45" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92cfe1f-b719-4fd8-8268-816c1c842d23]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:22 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.368s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Deleted volume successfully. Nov 01 09:54:22 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 Nov 01 09:54:22 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-c3f9d93c-5f68-44c0-9404-419e27725d40 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-8137a140-02a3-4c0e-9c62-ea729e44f8f1-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:22 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:22 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 1G" returned: 0 in 0.649s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a66e2b4-7033-4835-829c-77d9cfd185ef -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45" returned: 0 in 0.528s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:22 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a66e2b4-7033-4835-829c-77d9cfd185ef -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 Nov 01 09:54:22 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:22 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45 Nov 01 09:54:22 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:23 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-f9b88b22-3428-4f47-ba55-030214d86e45" returned: 0 in 0.314s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-f9b88b22-3428-4f47-ba55-030214d86e45" released by "delete_volume" :: held 0.914s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:23 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a66e2b4-7033-4835-829c-77d9cfd185ef -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9" returned: 0 in 0.427s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:23 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 is being set with open permissions: ugo+rw Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Created reservations ['b789ce41-652e-4ba7-8423-e7674cd2d7a9', '433840cd-0ef4-4fc5-aa96-2f2a3d8bd484', '93ee4f5e-a208-4187-a084-49de8025934c', 'e22cf47e-716f-44b8-95d2-001845a95c3b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:23 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 Nov 01 09:54:23 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Flow 'volume_create_manager' (7a40bc0a-bcdf-452a-b260-dac004b6bfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7fd364-4b0a-4953-ab0f-2626efdf8d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7fd364-4b0a-4953-ab0f-2626efdf8d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-805944806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a3910f-df94-4f2c-8ecd-7fd0d5343a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefe33b9befa4a739735c2427c58c49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:23Z,use_quota=True,user_id='69e8b71bc579421a9873755bc550b9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccd9f9a-a9e4-460c-a4e1-a291e19e0c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccd9f9a-a9e4-460c-a4e1-a291e19e0c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20d4be0-eb11-4476-a53b-a0ab6b2aa4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20d4be0-eb11-4476-a53b-a0ab6b2aa4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a3910f-df94-4f2c-8ecd-7fd0d5343a07', 'volume_name': 'volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9888ae74-ab55-4d6f-bbbe-fa6568226d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9888ae74-ab55-4d6f-bbbe-fa6568226d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec795260-53d9-4193-8f17-e63267e4b4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Volume e8a3910f-df94-4f2c-8ecd-7fd0d5343a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07', 'volume_size': 1} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:23 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:23 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:23 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9" returned: 0 in 0.318s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:23 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.info Nov 01 09:54:23 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:23 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.350s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:23 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Deleted volume successfully. Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7ba594ad-0720-4d7f-821d-250977fd8213 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-f9b88b22-3428-4f47-ba55-030214d86e45-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:23 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.info" returned: 0 in 0.308s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:23 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.info is being set with open permissions: ugo+rw Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:23 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.info Nov 01 09:54:23 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (fdd67188-207d-4228-b257-f204cabdb961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcf0e79-83fe-4abb-9db2-4510b19298a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbcf0e79-83fe-4abb-9db2-4510b19298a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2129769873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d1db55-0fb7-422c-97d3-08798dc320b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:24Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79993281-6dab-4ae0-b27b-b29e6ae93efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79993281-6dab-4ae0-b27b-b29e6ae93efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb6f684-8c49-4efd-a86f-8255a54d6833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cb6f684-8c49-4efd-a86f-8255a54d6833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d1db55-0fb7-422c-97d3-08798dc320b4', 'volume_name': 'volume-93d1db55-0fb7-422c-97d3-08798dc320b4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6378916a-5f26-447e-a14c-10d9824a810c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6378916a-5f26-447e-a14c-10d9824a810c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b97adf7-4d2a-45b1-a3c1-70f915641e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:24 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume 93d1db55-0fb7-422c-97d3-08798dc320b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d1db55-0fb7-422c-97d3-08798dc320b4', 'volume_size': 1} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:24 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.info" returned: 0 in 0.249s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.701s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-805944806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8a3910f-df94-4f2c-8ecd-7fd0d5343a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefe33b9befa4a739735c2427c58c49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:23Z,use_quota=True,user_id='69e8b71bc579421a9873755bc550b9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Creating volume e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:24 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:24 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 1073741824 Nov 01 09:54:24 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:24 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-75a3f58b-c7fa-443f-a383-eac57262fe90 tempest-ProjectReaderTests-1292665826 None] Create snapshot completed successfully Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-219caf05-9f54-4dcb-ba10-25a846a568c7-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-219caf05-9f54-4dcb-ba10-25a846a568c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-quobyte-219caf05-9f54-4dcb-ba10-25a846a568c7" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-219caf05-9f54-4dcb-ba10-25a846a568c7" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[be842e00-2fe9-417d-b866-fb690991d3e8]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:24 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 Nov 01 09:54:24 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:24 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 1073741824" returned: 0 in 0.470s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:24 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 Nov 01 09:54:24 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-7a66e2b4-7033-4835-829c-77d9cfd185ef" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-7a66e2b4-7033-4835-829c-77d9cfd185ef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Deleting offline snapshot 705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 of volume 7a66e2b4-7033-4835-829c-77d9cfd185ef {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] snapshot_file for this snap is: volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f77fcd0-b801-4913-a884-087d7dfc31b2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:24 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7" returned: 0 in 0.410s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:24 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 Nov 01 09:54:24 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:24 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7 Nov 01 09:54:24 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:24 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" returned: 0 in 0.293s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2129769873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d1db55-0fb7-422c-97d3-08798dc320b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:24Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Creating volume 93d1db55-0fb7-422c-97d3-08798dc320b4 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:24 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec795260-53d9-4193-8f17-e63267e4b4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:25 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 1073741824 Nov 01 09:54:25 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a64ddf-f25b-455b-9478-b4439475632f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:25 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Volume volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 (e8a3910f-df94-4f2c-8ecd-7fd0d5343a07): created successfully Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a64ddf-f25b-455b-9478-b4439475632f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Flow 'volume_create_manager' (7a40bc0a-bcdf-452a-b260-dac004b6bfc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-aaa1c5fb-31c7-40fd-9162-e7a7d5aac756 tempest-VolumeDependencyTests-1922416133 None] Created volume successfully. Nov 01 09:54:25 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-219caf05-9f54-4dcb-ba10-25a846a568c7" returned: 0 in 0.272s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:25 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-219caf05-9f54-4dcb-ba10-25a846a568c7" released by "delete_volume" :: held 0.732s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9" returned: 0 in 0.416s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a66e2b4-7033-4835-829c-77d9cfd185ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[961fc245-e800-4441-ad04-c44a77efcbcc]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Created reservations ['976b5346-5914-4e57-a072-22358d77bac0', 'f99c4d27-45f2-4c56-9c30-29f1431522fc', '9f54df78-6b56-41d7-b837-7d31ec015a50', 'de508112-c2db-4544-b0b8-f02cb9fa55f0'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:25 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef Nov 01 09:54:25 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:25 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:25 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:25 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 1073741824" returned: 0 in 0.582s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-dd78d7b7-146a-4fe8-a27a-374f463b2af9-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:25 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 Nov 01 09:54:25 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-dd78d7b7-146a-4fe8-a27a-374f463b2af9-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:25 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef" returned: 0 in 0.483s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:25 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.373s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:25 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 Nov 01 09:54:25 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Deleted volume successfully. Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-quobyte-dd78d7b7-146a-4fe8-a27a-374f463b2af9" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b8280e19-a1ad-4985-b480-7228da150562 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-219caf05-9f54-4dcb-ba10-25a846a568c7-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-dd78d7b7-146a-4fe8-a27a-374f463b2af9" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f910dc9-c453-40ce-b1b9-b28ab42bd278]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:25 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4" returned: 0 in 0.314s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.218s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:25 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 Nov 01 09:54:25 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b97adf7-4d2a-45b1-a3c1-70f915641e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d1db55-0fb7-422c-97d3-08798dc320b4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd36581-3b58-4644-aee9-f8fa5ec3562d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Creating offline snapshot 04b4386e-7122-4329-84e8-aff4f5e726fa of volume e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:54:26 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume volume-93d1db55-0fb7-422c-97d3-08798dc320b4 (93d1db55-0fb7-422c-97d3-08798dc320b4): created successfully Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bd36581-3b58-4644-aee9-f8fa5ec3562d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (fdd67188-207d-4228-b257-f204cabdb961) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d27a73-1fdb-43a8-bb1b-f39dc22835cf]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0f15672d-a514-4123-8d00-b3d375c99e8d tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created volume successfully. Nov 01 09:54:26 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9" returned: 0 in 0.404s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:26 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9 Nov 01 09:54:26 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:26 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 Nov 01 09:54:26 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:26 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9" returned: 0 in 0.385s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:26 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9 Nov 01 09:54:26 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:26 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef.705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9" returned: 0 in 0.262s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:26 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" returned: 0 in 0.373s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9" released by "_delete_snapshot" :: held 1.680s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-7a66e2b4-7033-4835-829c-77d9cfd185ef" released by "delete_snapshot" :: held 1.707s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:26 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa 1G Nov 01 09:54:26 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:26 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-dd78d7b7-146a-4fe8-a27a-374f463b2af9" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-dd78d7b7-146a-4fe8-a27a-374f463b2af9" released by "delete_volume" :: held 0.705s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Created reservations ['49efc883-c123-4dfe-a5d5-8860762e502e', '5166c8c6-9918-4afc-8d2e-773e661f6ffd', '5630429f-f746-4832-b35b-248911360344', '854d9ac9-1532-4e2f-9bc2-29f9af4e9f9f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Delete snapshot completed successfully. Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6f5d7b32-696c-4b99-a040-18e38f763823 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-705fbf5e-4160-42c0-b8ab-f35fe2cf8bc9-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Created reservations ['1bd2f9b2-1313-4161-a4b2-ca07c4c6ee54', '6556920b-14e0-4086-bb33-5167bd47df46', '3b2d5fe3-88cb-46e0-96eb-1a34fec01dfb', '5f373dba-b9b2-4f53-9861-80b9a2a6f5c0'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:26 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:26 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-quobyte-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-7a66e2b4-7033-4835-829c-77d9cfd185ef-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e" acquired by "delete_volume" :: waited 0.046s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:26 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Deleted volume successfully. Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-7a66e2b4-7033-4835-829c-77d9cfd185ef-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e32a22-ff6e-4866-888d-6b589e1102de]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:27 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa 1G" returned: 0 in 0.597s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5736a098-757f-4907-b9a8-9c89bc495025 tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-dd78d7b7-146a-4fe8-a27a-374f463b2af9-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:27 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa Nov 01 09:54:27 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-7a66e2b4-7033-4835-829c-77d9cfd185ef" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-7a66e2b4-7033-4835-829c-77d9cfd185ef" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:27 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e Nov 01 09:54:27 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c6b565-c6dc-4a65-83bd-07ca14d8517c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:27 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef Nov 01 09:54:27 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:27 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa" returned: 0 in 0.329s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:27 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa is being set with open permissions: ugo+rw Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:27 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa Nov 01 09:54:27 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:27 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e" returned: 0 in 0.451s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:27 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e Nov 01 09:54:27 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:27 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef" returned: 0 in 0.423s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:27 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef Nov 01 09:54:27 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:27 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa" returned: 0 in 0.313s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:27 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.info Nov 01 09:54:27 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:27 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e" returned: 0 in 0.327s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e" released by "delete_volume" :: held 0.860s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Created reservations ['57ce1431-3af1-41a2-b34d-804e72721637', '2364ac59-dca3-4aa2-86c9-0e7345ecde32', 'bbc3e8f0-acc3-4dad-b87b-1de8df875833', '85dc6ec6-b9cc-4e7c-9079-b147bdd95905'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:27 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:27 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (d206f97b-9fd5-4908-9747-951cfd392574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b082753-5e7f-43c0-97cf-3f2556418fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-a0a59c11-2544-425e-a8e3-88a8942264cb-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-7a66e2b4-7033-4835-829c-77d9cfd185ef" returned: 0 in 0.461s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b082753-5e7f-43c0-97cf-3f2556418fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550789098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ead234c-54d4-488a-82ba-cc76a209d050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:28Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38af8f9-296a-4e2d-8705-1a8ea388e249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38af8f9-296a-4e2d-8705-1a8ea388e249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56fd30c-4780-44d0-8da2-4a5b1eab61af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56fd30c-4780-44d0-8da2-4a5b1eab61af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ead234c-54d4-488a-82ba-cc76a209d050', 'volume_name': 'volume-5ead234c-54d4-488a-82ba-cc76a209d050', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2488e2-48b2-49db-882a-16bbb76b3984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2488e2-48b2-49db-882a-16bbb76b3984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c364e2-1e71-49b7-8ef7-a71444a95e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume 5ead234c-54d4-488a-82ba-cc76a209d050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ead234c-54d4-488a-82ba-cc76a209d050', 'volume_size': 1} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:28 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-7a66e2b4-7033-4835-829c-77d9cfd185ef" released by "delete_volume" :: held 1.051s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.info" returned: 0 in 0.421s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:28 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.info is being set with open permissions: ugo+rw Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-a0a59c11-2544-425e-a8e3-88a8942264cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.130s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-quobyte-c0b9ab4c-d787-465d-9792-a6c2852d962b" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:28 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.info Nov 01 09:54:28 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-c0b9ab4c-d787-465d-9792-a6c2852d962b" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:28 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:28 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-quobyte-a0a59c11-2544-425e-a8e3-88a8942264cb" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-a0a59c11-2544-425e-a8e3-88a8942264cb" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Deleting offline snapshot a0a59c11-2544-425e-a8e3-88a8942264cb of volume c0b9ab4c-d787-465d-9792-a6c2852d962b {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] snapshot_file for this snap is: volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Created reservations ['4178a024-4346-4be7-98e3-ce40449c6244', '362cf440-0647-4390-8dbe-9a74863e66ef', 'e2eb50cd-d9b1-423e-9420-5e30ceee0548', 'f9d76f1e-1d1a-44d3-bba1-220eb483b0e6'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efc0087-f915-4906-babb-95c142727d6e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:28 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.info" returned: 0 in 0.337s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:28 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:28 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.541s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1550789098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ead234c-54d4-488a-82ba-cc76a209d050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:28Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Creating volume 5ead234c-54d4-488a-82ba-cc76a209d050 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:28 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:28 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 1073741824 Nov 01 09:54:28 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:28 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb Nov 01 09:54:28 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f8665a56-aaed-4206-a36e-e1dac22c265c tempest-VolumeDependencyTests-1922416133 None] Create snapshot completed successfully Nov 01 09:54:28 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.467s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (6f1772a4-f9bb-4693-81fb-01f549803cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c257c1d5-abac-43e6-8b05-a75b2e466487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Deleted volume successfully. Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c257c1d5-abac-43e6-8b05-a75b2e466487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1707216503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a7c70f-b16f-47a2-8876-b112ea0a0667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:29Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b570d9d-84dc-4610-83c2-f4987afe6094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b570d9d-84dc-4610-83c2-f4987afe6094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01f2a5f-6762-4191-b66c-690fdcfd9e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01f2a5f-6762-4191-b66c-690fdcfd9e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a7c70f-b16f-47a2-8876-b112ea0a0667', 'volume_name': 'volume-00a7c70f-b16f-47a2-8876-b112ea0a0667', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0b3cfc-b687-4835-8e06-b87e9bb32b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0b3cfc-b687-4835-8e06-b87e9bb32b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df03a189-dd3f-4fe6-aca6-7e12174fc254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume 00a7c70f-b16f-47a2-8876-b112ea0a0667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a7c70f-b16f-47a2-8876-b112ea0a0667', 'volume_size': 1} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-2079ef84-81d1-40d6-b8ef-e20ef1e2edef tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-ed3461b1-d384-4d2b-89f8-cc0aa8e0957e-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:28 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.460s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Deleted volume successfully. Nov 01 09:54:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5c97f47f-46a1-4213-a03b-2a216bceb373 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-7a66e2b4-7033-4835-829c-77d9cfd185ef-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:29 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb" returned: 0 in 0.659s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b9ab4c-d787-465d-9792-a6c2852d962b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4b9da2-0305-4593-91d3-19914934db53]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:29 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b Nov 01 09:54:29 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:29 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (659ee05a-d5e8-4364-b143-5e5d35a04fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a26ef-f4df-4eb3-a1fa-1d0aad845c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 1073741824" returned: 0 in 0.756s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75a26ef-f4df-4eb3-a1fa-1d0aad845c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-252838748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5193ab1d-e9d2-44da-9c07-92b991ea8a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:29Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07e6e76-83f1-4498-b0e0-ecd6461438e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07e6e76-83f1-4498-b0e0-ecd6461438e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ac177-af86-4e52-b824-6ff4eae6192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b5ac177-af86-4e52-b824-6ff4eae6192a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5193ab1d-e9d2-44da-9c07-92b991ea8a61', 'volume_name': 'volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885c175a-380a-4be2-94fb-401d6730942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885c175a-380a-4be2-94fb-401d6730942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b579399-a68a-48de-b032-a19539ef3baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:29 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume 5193ab1d-e9d2-44da-9c07-92b991ea8a61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61', 'volume_size': 1} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:29 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 Nov 01 09:54:29 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:29 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b" returned: 0 in 0.743s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:29 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050" returned: 0 in 0.407s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:29 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:29 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1707216503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a7c70f-b16f-47a2-8876-b112ea0a0667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:29Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Creating volume 00a7c70f-b16f-47a2-8876-b112ea0a0667 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:29 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:29 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 1073741824 Nov 01 09:54:29 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c364e2-1e71-49b7-8ef7-a71444a95e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ead234c-54d4-488a-82ba-cc76a209d050', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56460278-551f-4425-8271-a1897d870709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume volume-5ead234c-54d4-488a-82ba-cc76a209d050 (5ead234c-54d4-488a-82ba-cc76a209d050): created successfully Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56460278-551f-4425-8271-a1897d870709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (d206f97b-9fd5-4908-9747-951cfd392574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-905e61d4-ac4a-4a29-b3cd-fcf0cd8f150c tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created volume successfully. Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (a8c729f2-1f80-4ffd-aadb-e2a0d0431379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a51af7-1a5f-42d0-982e-9c64cb946642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81a51af7-1a5f-42d0-982e-9c64cb946642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1229972493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb50edf-50cf-402d-9dda-8dc47fd24b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:30Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ba8bcf-f46c-4572-9b18-d3f4059a83ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ba8bcf-f46c-4572-9b18-d3f4059a83ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d9cb1-43ba-426b-95f5-d7ef592b3eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d9cb1-43ba-426b-95f5-d7ef592b3eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb50edf-50cf-402d-9dda-8dc47fd24b1e', 'volume_name': 'volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12043038-023a-4215-bf84-d333e5c7ff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12043038-023a-4215-bf84-d333e5c7ff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e2f5ff-2c5e-4822-bb75-ed33c7fb1762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume 8eb50edf-50cf-402d-9dda-8dc47fd24b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e', 'volume_size': 1} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:30 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb" returned: 0 in 0.601s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:30 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb Nov 01 09:54:30 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Flow 'volume_create_manager' (facbd0f7-46d4-46cc-8fad-28afb613761f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6442fb-9850-4413-bba4-2aefd8f10224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df6442fb-9850-4413-bba4-2aefd8f10224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2103796895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b30d9089-be9a-4919-8ca3-4b54be791fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aefe33b9befa4a739735c2427c58c49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=04b4386e-7122-4329-84e8-aff4f5e726fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:30Z,use_quota=True,user_id='69e8b71bc579421a9873755bc550b9e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fa2834-8cfd-4e3a-a546-339f4fd1810e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fa2834-8cfd-4e3a-a546-339f4fd1810e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69a0a95-ee20-41f7-8610-404bd96e2a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69a0a95-ee20-41f7-8610-404bd96e2a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b30d9089-be9a-4919-8ca3-4b54be791fb3', 'volume_name': 'volume-b30d9089-be9a-4919-8ca3-4b54be791fb3', 'volume_size': 1, 'snapshot_id': '04b4386e-7122-4329-84e8-aff4f5e726fa'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3763cfa-9b8f-4634-ac06-ce81505b7b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3763cfa-9b8f-4634-ac06-ce81505b7b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35891a4-714d-4271-a8e9-f127f70308a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Volume b30d9089-be9a-4919-8ca3-4b54be791fb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b30d9089-be9a-4919-8ca3-4b54be791fb3', 'volume_size': 1, 'snapshot_id': '04b4386e-7122-4329-84e8-aff4f5e726fa'} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 1073741824" returned: 0 in 0.724s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:30 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 Nov 01 09:54:30 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:30 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b.a0a59c11-2544-425e-a8e3-88a8942264cb" returned: 0 in 0.322s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-a0a59c11-2544-425e-a8e3-88a8942264cb" released by "_delete_snapshot" :: held 2.492s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-c0b9ab4c-d787-465d-9792-a6c2852d962b" released by "delete_snapshot" :: held 2.534s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (08cd770c-8a0c-44e4-9833-8a715fcd729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1044ebb-062e-4560-8c7c-ac58092e944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1044ebb-062e-4560-8c7c-ac58092e944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-896692174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a3e1e7-265d-490c-b4cd-7ca483306a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:31Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf95eef3-c442-4115-a0a2-f855f3427401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf95eef3-c442-4115-a0a2-f855f3427401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f259f0f9-21dc-47dc-9344-0acb84866944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f259f0f9-21dc-47dc-9344-0acb84866944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a3e1e7-265d-490c-b4cd-7ca483306a2e', 'volume_name': 'volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbff371-74b7-449c-b858-ee38b85dcd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbbff371-74b7-449c-b858-ee38b85dcd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4b4960-570f-4a01-8a8f-0dc0be3ba9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume a4a3e1e7-265d-490c-b4cd-7ca483306a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e', 'volume_size': 1} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (2e205f3d-5deb-4bfb-8d79-9976d4afc3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:30 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4da02c-1a19-4546-92a1-b50d654cccad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667" returned: 0 in 0.295s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.568s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-252838748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5193ab1d-e9d2-44da-9c07-92b991ea8a61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:29Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Creating volume 5193ab1d-e9d2-44da-9c07-92b991ea8a61 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:30 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:30 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 1073741824 Nov 01 09:54:30 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d4da02c-1a19-4546-92a1-b50d654cccad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926043148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0dbe74-bd18-4981-9083-09bdcd03a63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:31Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a6daa6-ad9e-497d-8055-37d8464b0d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a6daa6-ad9e-497d-8055-37d8464b0d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9c32fe-8c29-40f6-9c3b-6f92fad744cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9c32fe-8c29-40f6-9c3b-6f92fad744cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f0dbe74-bd18-4981-9083-09bdcd03a63b', 'volume_name': 'volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2580a32e-cc6b-4375-a80f-4a2f9700c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2580a32e-cc6b-4375-a80f-4a2f9700c875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbc32bc-ff34-4097-933c-6aada099f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:31 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Volume 0f0dbe74-bd18-4981-9083-09bdcd03a63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b', 'volume_size': 1} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df03a189-dd3f-4fe6-aca6-7e12174fc254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a7c70f-b16f-47a2-8876-b112ea0a0667', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7a2f91-ffdf-4917-85aa-058956d61434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:31 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 (00a7c70f-b16f-47a2-8876-b112ea0a0667): created successfully Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7a2f91-ffdf-4917-85aa-058956d61434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (6f1772a4-f9bb-4693-81fb-01f549803cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Created reservations ['b4dfe759-bcc8-4585-951e-42e454c1abc2', '1245dcbf-9fe9-4a0e-ab4f-06fb2fa4d3ad', '39859243-9d4f-4019-aa71-f7be1880d87d', '61421695-b047-4450-82e6-302a448735a0'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-984f74fa-a2d0-4d46-9f3c-a1cb234ebe96 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created volume successfully. Nov 01 09:54:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Delete snapshot completed successfully. Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b5b1356-bae5-47b6-8489-f745186242ed tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-a0a59c11-2544-425e-a8e3-88a8942264cb-delete_snapshot" released by "delete_snapshot" :: held 2.967s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:31 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 1073741824" returned: 0 in 0.447s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:31 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 Nov 01 09:54:31 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-c0b9ab4c-d787-465d-9792-a6c2852d962b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-c0b9ab4c-d787-465d-9792-a6c2852d962b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "cinder-quobyte-c0b9ab4c-d787-465d-9792-a6c2852d962b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-c0b9ab4c-d787-465d-9792-a6c2852d962b" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:31 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1229972493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb50edf-50cf-402d-9dda-8dc47fd24b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:30Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Creating volume 8eb50edf-50cf-402d-9dda-8dc47fd24b1e {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:31 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebaf280-7a06-45fe-943e-1f56d8b5415e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:31 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e 1073741824 Nov 01 09:54:31 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b579399-a68a-48de-b032-a19539ef3baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab94b5d-4424-4212-93cb-7fca9dab5f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:31 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 (5193ab1d-e9d2-44da-9c07-92b991ea8a61): created successfully Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab94b5d-4424-4212-93cb-7fca9dab5f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (659ee05a-d5e8-4364-b143-5e5d35a04fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a77a0a4e-754b-45e7-96de-6fe332c79b07 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created volume successfully. Nov 01 09:54:31 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b Nov 01 09:54:31 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:32 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b" returned: 0 in 0.380s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:32 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e 1073741824" returned: 0 in 0.425s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:32 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b Nov 01 09:54:32 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:32 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e Nov 01 09:54:32 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:32 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c0b9ab4c-d787-465d-9792-a6c2852d962b" returned: 0 in 0.246s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-quobyte-c0b9ab4c-d787-465d-9792-a6c2852d962b" released by "delete_volume" :: held 0.712s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:32 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.836s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-quobyte-04b4386e-7122-4329-84e8-aff4f5e726fa-b30d9089-be9a-4919-8ca3-4b54be791fb3" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Created reservations ['1262021a-4859-404f-9514-c8f2b91e9533', '2a107432-d87b-4094-ac56-a326c3681c5e', '4693e8e0-1667-4753-9cec-4be0e70ce432', '2411eb93-a5ff-4d9e-bec9-9f7091f56aab'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10e2f5ff-2c5e-4822-bb75-ed33c7fb1762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4f8be9-de8c-4e57-a707-75641c388304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-04b4386e-7122-4329-84e8-aff4f5e726fa-b30d9089-be9a-4919-8ca3-4b54be791fb3" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Creating volume b30d9089-be9a-4919-8ca3-4b54be791fb3 from snapshot 04b4386e-7122-4329-84e8-aff4f5e726fa {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-quobyte-b30d9089-be9a-4919-8ca3-4b54be791fb3" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:32 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e (8eb50edf-50cf-402d-9dda-8dc47fd24b1e): created successfully Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4f8be9-de8c-4e57-a707-75641c388304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (a8c729f2-1f80-4ffd-aadb-e2a0d0431379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-b30d9089-be9a-4919-8ca3-4b54be791fb3" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] snapshot: 04b4386e-7122-4329-84e8-aff4f5e726fa, volume: b30d9089-be9a-4919-8ca3-4b54be791fb3, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8fdc5634-54b9-4550-9458-c74b9ef0b35a tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created volume successfully. Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeed1ef-9ce8-4e2e-bfa0-7845aa2a1f00]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:32 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:32 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:32 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa Nov 01 09:54:32 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:32 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.284s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Deleted volume successfully. Nov 01 09:54:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-fee87a7e-524e-4196-b26c-79e66e38f65a tempest-CreateVolumesFromSnapshotTest-681756397 None] Lock "cinder-c0b9ab4c-d787-465d-9792-a6c2852d962b-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:33 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa" returned: 0 in 0.397s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f737e4-0e81-40f2-b9dc-c4b12d634c85]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:33 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 Nov 01 09:54:33 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:33 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" returned: 0 in 0.362s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:54:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:33 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 Nov 01 09:54:33 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Flow 'volume_create_manager' (8b344d95-ade7-431d-a7b0-dc0412737603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75401454-a43a-4eab-80f3-92dd48b1a003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75401454-a43a-4eab-80f3-92dd48b1a003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46739e91-e94a-4418-98a1-cba60b375a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b728fee2ed4cc6b70d3ce422c9fcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:37Z,use_quota=True,user_id='56340764171f48fa933e91ce2dd79f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8060ab8a-6dc2-42c6-84d8-bfcc91a5019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8060ab8a-6dc2-42c6-84d8-bfcc91a5019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20381219-b643-46b7-b388-fac3d7f56577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20381219-b643-46b7-b388-fac3d7f56577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46739e91-e94a-4418-98a1-cba60b375a6e', 'volume_name': 'volume-46739e91-e94a-4418-98a1-cba60b375a6e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b45729-9e63-45cd-8f4d-0261a9e4f167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b45729-9e63-45cd-8f4d-0261a9e4f167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10756c9-27b6-4c3c-a892-4dfd32bcf9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:37 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Volume 46739e91-e94a-4418-98a1-cba60b375a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46739e91-e94a-4418-98a1-cba60b375a6e', 'volume_size': 1} Nov 01 09:54:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:40 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3" returned: 0 in 6.736s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:54:40 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Converted 1024.00 MB image at 152.00 MB/s Nov 01 09:54:40 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 is being set with open permissions: ugo+rw Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:40 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 Nov 01 09:54:40 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:40 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3" returned: 0 in 0.237s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-b30d9089-be9a-4919-8ca3-4b54be791fb3" released by "_copy_volume_from_snapshot" :: held 7.833s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-04b4386e-7122-4329-84e8-aff4f5e726fa-b30d9089-be9a-4919-8ca3-4b54be791fb3" released by "_create_volume_from_snapshot" :: held 7.911s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.951s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.510s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-896692174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a3e1e7-265d-490c-b4cd-7ca483306a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adf0400156014017a0e66828991e77c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:31Z,use_quota=True,user_id='7427afab3aa94e20b66fd94fbcf6bab1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Creating volume a4a3e1e7-265d-490c-b4cd-7ca483306a2e {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:40 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:40 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e 1073741824 Nov 01 09:54:40 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35891a4-714d-4271-a8e9-f127f70308a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b30d9089-be9a-4919-8ca3-4b54be791fb3', 'volume_size': 1, 'snapshot_id': '04b4386e-7122-4329-84e8-aff4f5e726fa'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8174d929-5115-4e42-ba14-4f9ebc597c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:40 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Volume volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 (b30d9089-be9a-4919-8ca3-4b54be791fb3): created successfully Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8174d929-5115-4e42-ba14-4f9ebc597c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Flow 'volume_create_manager' (facbd0f7-46d4-46cc-8fad-28afb613761f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:40 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d85063e8-e72c-477d-91fc-c4b8f374ef45 tempest-VolumeDependencyTests-1922416133 None] Created volume successfully. Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-04b4386e-7122-4329-84e8-aff4f5e726fa-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-04b4386e-7122-4329-84e8-aff4f5e726fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-quobyte-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-quobyte-04b4386e-7122-4329-84e8-aff4f5e726fa" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-04b4386e-7122-4329-84e8-aff4f5e726fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Deleting offline snapshot 04b4386e-7122-4329-84e8-aff4f5e726fa of volume e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] snapshot_file for this snap is: volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b37c65-2d1e-4900-80fd-1b8dfaf53b58]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:40 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa Nov 01 09:54:40 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:40 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e 1073741824" returned: 0 in 0.432s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:40 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e Nov 01 09:54:40 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:41 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa" returned: 0 in 0.369s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4df40f-b186-4f94-8943-d9c13d42c349]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:41 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e" returned: 0 in 0.280s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.145s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926043148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f0dbe74-bd18-4981-9083-09bdcd03a63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:31Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Creating volume 0f0dbe74-bd18-4981-9083-09bdcd03a63b {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:41 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:41 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 Nov 01 09:54:41 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4b4960-570f-4a01-8a8f-0dc0be3ba9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:41 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b 1073741824 Nov 01 09:54:41 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3826bc7-822d-423f-928a-925398494a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:41 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Volume volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e (a4a3e1e7-265d-490c-b4cd-7ca483306a2e): created successfully Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3826bc7-822d-423f-928a-925398494a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Flow 'volume_create_manager' (08cd770c-8a0c-44e4-9833-8a715fcd729c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1b36f921-700b-412e-85ab-3d8ec8897be3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created volume successfully. Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-a4a3e1e7-265d-490c-b4cd-7ca483306a2e-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-a4a3e1e7-265d-490c-b4cd-7ca483306a2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:41 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:41 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b 1073741824" returned: 0 in 0.471s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" returned: 0 in 0.564s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:41 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa Nov 01 09:54:41 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-quobyte-a4a3e1e7-265d-490c-b4cd-7ca483306a2e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-a4a3e1e7-265d-490c-b4cd-7ca483306a2e" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fcc759-5b60-444b-abeb-79dbfede68fe]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:41 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b Nov 01 09:54:41 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:41 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e Nov 01 09:54:41 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:42 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b" returned: 0 in 0.272s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.820s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46739e91-e94a-4418-98a1-cba60b375a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b728fee2ed4cc6b70d3ce422c9fcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:37Z,use_quota=True,user_id='56340764171f48fa933e91ce2dd79f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Creating volume 46739e91-e94a-4418-98a1-cba60b375a6e {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:42 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:42 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcbc32bc-ff34-4097-933c-6aada099f839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fe4e75-f387-4a9b-b12b-59b8b99d81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:42 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e 1073741824 Nov 01 09:54:42 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa" returned: 0 in 0.399s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:42 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Volume volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b (0f0dbe74-bd18-4981-9083-09bdcd03a63b): created successfully Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3fe4e75-f387-4a9b-b12b-59b8b99d81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:42 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa Nov 01 09:54:42 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (2e205f3d-5deb-4bfb-8d79-9976d4afc3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d61f4956-2a34-48f8-8323-bf250896b535 tempest-ProjectReaderTests-1292665826 None] Created volume successfully. Nov 01 09:54:42 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e" returned: 0 in 0.443s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:42 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e Nov 01 09:54:42 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:42 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07.04b4386e-7122-4329-84e8-aff4f5e726fa" returned: 0 in 0.308s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-04b4386e-7122-4329-84e8-aff4f5e726fa" released by "_delete_snapshot" :: held 1.782s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" released by "delete_snapshot" :: held 1.812s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:42 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-a4a3e1e7-265d-490c-b4cd-7ca483306a2e" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-a4a3e1e7-265d-490c-b4cd-7ca483306a2e" released by "delete_volume" :: held 0.781s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Created reservations ['0c6ad82d-9475-4a27-b607-17254f309616', 'e28e7b86-5927-4033-b64f-2f1b0f7922a4', 'e4324d00-c3c4-4544-92c0-78d3484d98ff', 'abd09c46-21ea-4619-a658-7d759877a94f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:42 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e 1073741824" returned: 0 in 0.538s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created reservations ['95f580e8-f102-4537-bd08-ab774b814993', '24ec04b7-87ed-485b-a1af-1cb206260b25', 'e093d777-7f53-46f9-ba4f-24a0bcc0b73d', 'b96cd15a-ef29-4a9f-af7b-7adfbefc11a4'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Delete snapshot completed successfully. Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-01b6f82a-2b75-484c-b4cd-65d8f8947474 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-04b4386e-7122-4329-84e8-aff4f5e726fa-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:42 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e Nov 01 09:54:42 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:42 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:42 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-8eb50edf-50cf-402d-9dda-8dc47fd24b1e-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:42 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e" returned: 0 in 0.297s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.443s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:42 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-8eb50edf-50cf-402d-9dda-8dc47fd24b1e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:42 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10756c9-27b6-4c3c-a892-4dfd32bcf9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46739e91-e94a-4418-98a1-cba60b375a6e', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5791c9-c455-46bb-b557-a25cfafa0066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Creating offline snapshot be928ccf-4f3e-4231-b8e2-e5e843bc6fea of volume 0f0dbe74-bd18-4981-9083-09bdcd03a63b {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.356s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:43 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Deleted volume successfully. Nov 01 09:54:43 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Volume volume-46739e91-e94a-4418-98a1-cba60b375a6e (46739e91-e94a-4418-98a1-cba60b375a6e): created successfully Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf5791c9-c455-46bb-b557-a25cfafa0066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Flow 'volume_create_manager' (8b344d95-ade7-431d-a7b0-dc0412737603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a161ee04-f2ae-4810-94b5-b2c1bea1efac]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-quobyte-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:43 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b6c20972-4221-4a1f-bf00-139530994b6e tempest-CinderUnicodeTest-1841900889 None] Created volume successfully. Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0cb5638f-079b-4a44-bf45-9eb1b489dea3 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-a4a3e1e7-265d-490c-b4cd-7ca483306a2e-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" acquired by "delete_volume" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[42958ea1-50c0-4540-a5bd-7581c7a76bfe]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-quobyte-8eb50edf-50cf-402d-9dda-8dc47fd24b1e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:43 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b Nov 01 09:54:43 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-8eb50edf-50cf-402d-9dda-8dc47fd24b1e" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f26e68-682d-429a-bb7b-c145bdf27006]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:43 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 Nov 01 09:54:43 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:43 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e Nov 01 09:54:43 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:43 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b" returned: 0 in 0.417s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:43 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea 1G Nov 01 09:54:43 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:43 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" returned: 0 in 0.424s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:43 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07 Nov 01 09:54:43 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:43 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e" returned: 0 in 0.461s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:43 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e Nov 01 09:54:43 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:43 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" returned: 0 in 0.304s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:43 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07" released by "delete_volume" :: held 0.803s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Created reservations ['0fe0167e-3d63-4c17-9664-37ae184bbdf7', '6291e200-62f5-469a-9d25-9b952cc3f622', '50fef91f-1311-425a-bc84-1dced354b48b', '461503da-d367-42b3-bfb1-175fb834a926'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Flow 'volume_create_manager' (7bb1d1be-7021-4ba8-9274-1bb5a0d803f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:44 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c9f9ac-959e-43f3-a228-da1b1111b626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:44 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-8eb50edf-50cf-402d-9dda-8dc47fd24b1e" returned: 0 in 0.395s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea 1G" returned: 0 in 0.602s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:44 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea Nov 01 09:54:44 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c9f9ac-959e-43f3-a228-da1b1111b626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1477889875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d928e2-4e14-43ed-b263-3ac1197774eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b728fee2ed4cc6b70d3ce422c9fcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:44Z,use_quota=True,user_id='56340764171f48fa933e91ce2dd79f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b1dfcf-f703-4ff9-8cc5-3f04192fc29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b1dfcf-f703-4ff9-8cc5-3f04192fc29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df22216a-37ba-48c1-8f69-72752d5d0ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df22216a-37ba-48c1-8f69-72752d5d0ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d928e2-4e14-43ed-b263-3ac1197774eb', 'volume_name': 'volume-c2d928e2-4e14-43ed-b263-3ac1197774eb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00de0bc8-a95d-402d-8e73-d197bd95021b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00de0bc8-a95d-402d-8e73-d197bd95021b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a09c533-4ba8-4676-be1d-ef826e4608e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:44 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Volume c2d928e2-4e14-43ed-b263-3ac1197774eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d928e2-4e14-43ed-b263-3ac1197774eb', 'volume_size': 1} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-8eb50edf-50cf-402d-9dda-8dc47fd24b1e" released by "delete_volume" :: held 0.977s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created reservations ['f59e0322-3ad1-4543-b95f-927dd359de5a', 'c50a7d16-5d3b-4bbe-ad33-3a75b5f5cffb', 'ad8ff8e9-6bef-4989-a045-700dec014e6c', '887f8ef0-4277-459f-91bd-df88610d75c6'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:44 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:44 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:44 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:44 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:44 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea" returned: 0 in 0.309s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:44 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea is being set with open permissions: ugo+rw Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:44 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea Nov 01 09:54:44 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:44 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:44 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Deleted volume successfully. Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6ec2715f-bd7d-4d40-b606-2dd68bb39711 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-e8a3910f-df94-4f2c-8ecd-7fd0d5343a07-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:44 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.304s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:44 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Deleted volume successfully. Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7b75f9bb-65ff-490e-bb87-55c2bf2a3515 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-8eb50edf-50cf-402d-9dda-8dc47fd24b1e-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:44 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea" returned: 0 in 0.294s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:44 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.info Nov 01 09:54:44 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:44 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.info" returned: 0 in 0.251s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:44 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.info is being set with open permissions: ugo+rw Nov 01 09:54:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:45 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.info Nov 01 09:54:45 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-b30d9089-be9a-4919-8ca3-4b54be791fb3-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-b30d9089-be9a-4919-8ca3-4b54be791fb3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-5193ab1d-e9d2-44da-9c07-92b991ea8a61-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "cinder-quobyte-b30d9089-be9a-4919-8ca3-4b54be791fb3" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-5193ab1d-e9d2-44da-9c07-92b991ea8a61-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-b30d9089-be9a-4919-8ca3-4b54be791fb3" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df4de60-fc52-4151-b058-a3f0cfa8e429]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-quobyte-5193ab1d-e9d2-44da-9c07-92b991ea8a61" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:45 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.info" returned: 0 in 0.288s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.120s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:44Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1477889875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d928e2-4e14-43ed-b263-3ac1197774eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b728fee2ed4cc6b70d3ce422c9fcc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:44Z,use_quota=True,user_id='56340764171f48fa933e91ce2dd79f98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Creating volume c2d928e2-4e14-43ed-b263-3ac1197774eb {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:45 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-5193ab1d-e9d2-44da-9c07-92b991ea8a61" acquired by "delete_volume" :: waited 0.072s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:45 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb 1073741824 Nov 01 09:54:45 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:45 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 Nov 01 09:54:45 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-cd34a828-e0c7-418e-a9e1-c9e0c8150acf tempest-ProjectReaderTests-1292665826 None] Create snapshot completed successfully Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dea223-5a0d-49ac-9b4a-fcdcb07bbdeb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:45 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 Nov 01 09:54:45 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:45 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3" returned: 0 in 0.405s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:45 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3 Nov 01 09:54:45 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-be928ccf-4f3e-4231-b8e2-e5e843bc6fea-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-be928ccf-4f3e-4231-b8e2-e5e843bc6fea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-0f0dbe74-bd18-4981-9083-09bdcd03a63b" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-0f0dbe74-bd18-4981-9083-09bdcd03a63b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-be928ccf-4f3e-4231-b8e2-e5e843bc6fea" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-be928ccf-4f3e-4231-b8e2-e5e843bc6fea" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Deleting offline snapshot be928ccf-4f3e-4231-b8e2-e5e843bc6fea of volume 0f0dbe74-bd18-4981-9083-09bdcd03a63b {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:54:45 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] snapshot_file for this snap is: volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61" returned: 0 in 0.456s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea411f3-1a5f-4f2f-8ae8-6caa7a189e28]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:45 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb 1073741824" returned: 0 in 0.562s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:45 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61 Nov 01 09:54:45 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:45 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb Nov 01 09:54:45 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:45 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-b30d9089-be9a-4919-8ca3-4b54be791fb3" returned: 0 in 0.300s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-quobyte-b30d9089-be9a-4919-8ca3-4b54be791fb3" released by "delete_volume" :: held 0.775s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:45 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea Nov 01 09:54:45 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Created reservations ['def87756-b82f-4c62-a27b-ecabdebd1b3e', '9619790d-ba70-46b2-97bf-098074096b77', 'e26370fd-e240-4f04-b378-ebecdd61cecc', '9414282e-a6b0-435c-bb0c-87472af8c12c'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:46 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:46 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:46 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5193ab1d-e9d2-44da-9c07-92b991ea8a61" returned: 0 in 0.387s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-5193ab1d-e9d2-44da-9c07-92b991ea8a61" released by "delete_volume" :: held 0.911s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:46 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb" returned: 0 in 0.386s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a09c533-4ba8-4676-be1d-ef826e4608e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d928e2-4e14-43ed-b263-3ac1197774eb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7659da-5762-47fa-bf8d-0be7907ea5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created reservations ['42757a26-5ffc-42ce-a745-b241362bdc34', '0dfce4f2-aad3-4df8-aed4-0e2a76e3fa62', 'd64bbda0-1bd8-46f2-a58f-e4afb525a6b5', 'd832822b-335e-413a-a326-2de5b69fda93'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:46 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Volume volume-c2d928e2-4e14-43ed-b263-3ac1197774eb (c2d928e2-4e14-43ed-b263-3ac1197774eb): created successfully Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7659da-5762-47fa-bf8d-0be7907ea5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Flow 'volume_create_manager' (7bb1d1be-7021-4ba8-9274-1bb5a0d803f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:46 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ad05f379-55f1-44e0-bb2d-31c8f1834536 tempest-CinderUnicodeTest-1841900889 None] Created volume successfully. Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea" returned: 0 in 0.558s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba21a9e-92e9-404d-8426-629b780d7da9]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:46 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.387s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Deleted volume successfully. Nov 01 09:54:46 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:46 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-31749e80-ef1e-4a4a-a80a-c7302320d072 tempest-VolumeDependencyTests-1922416133 None] Lock "cinder-b30d9089-be9a-4919-8ca3-4b54be791fb3-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:46 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b Nov 01 09:54:46 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:46 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.271s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Deleted volume successfully. Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-60e1c464-7760-4edc-b6f6-0847a19a84d6 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-5193ab1d-e9d2-44da-9c07-92b991ea8a61-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:46 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b" returned: 0 in 0.434s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:46 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea Nov 01 09:54:46 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:47 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea" returned: 0 in 0.422s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:47 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea Nov 01 09:54:47 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-00a7c70f-b16f-47a2-8876-b112ea0a0667-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-00a7c70f-b16f-47a2-8876-b112ea0a0667-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-quobyte-00a7c70f-b16f-47a2-8876-b112ea0a0667" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-00a7c70f-b16f-47a2-8876-b112ea0a0667" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9069105f-678c-4b37-b39f-ea26977b6d3c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Creating offline snapshot b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 of volume c2d928e2-4e14-43ed-b263-3ac1197774eb {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cd9cd4-412b-4a0a-be35-0984b1aefd13]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:47 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b.be928ccf-4f3e-4231-b8e2-e5e843bc6fea" returned: 0 in 0.392s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-be928ccf-4f3e-4231-b8e2-e5e843bc6fea" released by "_delete_snapshot" :: held 1.945s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-0f0dbe74-bd18-4981-9083-09bdcd03a63b" released by "delete_snapshot" :: held 1.982s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:47 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 Nov 01 09:54:47 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:47 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb Nov 01 09:54:47 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Created reservations ['7d182a11-0161-43c0-a88b-14a521625f80', 'fd3fe30b-bc8c-4ca4-8214-259de74721f1', '95c513a5-257b-4d30-b066-eb922e495771', '865444f5-a507-4489-825d-78f1e24fa33b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:47 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Delete snapshot completed successfully. Nov 01 09:54:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-24d3c3a3-dec6-48f7-b3c5-2f234fe48432 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-be928ccf-4f3e-4231-b8e2-e5e843bc6fea-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:48 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667" returned: 0 in 0.434s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:48 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667 Nov 01 09:54:48 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:48 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb" returned: 0 in 0.477s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:48 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 1G Nov 01 09:54:48 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:48 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-00a7c70f-b16f-47a2-8876-b112ea0a0667" returned: 0 in 0.314s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-00a7c70f-b16f-47a2-8876-b112ea0a0667" released by "delete_volume" :: held 0.807s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created reservations ['98fee352-db32-4b4e-adbe-4e0da483cd8a', '268fc0b3-b957-487b-acf9-7c2e2c3f3233', '7ea998f7-5087-4f1e-9978-557982b891ac', '10a4a7f0-e463-4157-93bd-ae680f889ca9'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:48 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:48 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-5ead234c-54d4-488a-82ba-cc76a209d050-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-5ead234c-54d4-488a-82ba-cc76a209d050-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-quobyte-5ead234c-54d4-488a-82ba-cc76a209d050" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-5ead234c-54d4-488a-82ba-cc76a209d050" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:48 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 1G" returned: 0 in 0.622s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d928e2-4e14-43ed-b263-3ac1197774eb -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7305734d-1d4b-4507-a255-e2d84fcbe172]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:48 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d928e2-4e14-43ed-b263-3ac1197774eb -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 Nov 01 09:54:48 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:48 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 Nov 01 09:54:48 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:49 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.388s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:49 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Deleted volume successfully. Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-20a1074d-ff82-46b6-8911-6c2af19639d2 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-00a7c70f-b16f-47a2-8876-b112ea0a0667-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-0f0dbe74-bd18-4981-9083-09bdcd03a63b-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Lock "cinder-0f0dbe74-bd18-4981-9083-09bdcd03a63b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-0f0dbe74-bd18-4981-9083-09bdcd03a63b" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-0f0dbe74-bd18-4981-9083-09bdcd03a63b" acquired by "delete_volume" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:49 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d928e2-4e14-43ed-b263-3ac1197774eb -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880" returned: 0 in 0.428s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:49 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 is being set with open permissions: ugo+rw Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ac130b-d607-434a-9272-03aa86088915]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:49 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 Nov 01 09:54:49 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:49 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050" returned: 0 in 0.493s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:49 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050 Nov 01 09:54:49 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:49 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b Nov 01 09:54:49 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:49 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880" returned: 0 in 0.305s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:49 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5ead234c-54d4-488a-82ba-cc76a209d050" returned: 0 in 0.322s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:49 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.info Nov 01 09:54:49 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-5ead234c-54d4-488a-82ba-cc76a209d050" released by "delete_volume" :: held 0.880s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:49 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b" returned: 0 in 0.491s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created reservations ['53ff4080-b59e-4f9f-9332-e4ce4be68be4', '7fddf9d3-6bf8-402e-ba21-e7e496005247', '651e31e4-d4c3-495c-a1f7-2b91ac50cdbb', 'b85937c2-f871-4372-8417-2e9ffa0077ba'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:49 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b Nov 01 09:54:49 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:49 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:49 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:49 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-93d1db55-0fb7-422c-97d3-08798dc320b4-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.info" returned: 0 in 0.338s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:49 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.info is being set with open permissions: ugo+rw Nov 01 09:54:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-93d1db55-0fb7-422c-97d3-08798dc320b4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:50 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.info Nov 01 09:54:50 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "cinder-quobyte-93d1db55-0fb7-422c-97d3-08798dc320b4" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-93d1db55-0fb7-422c-97d3-08798dc320b4" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d09f0c-ff4f-45fe-9d1a-db1aaa6b1a92]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:50 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0f0dbe74-bd18-4981-9083-09bdcd03a63b" returned: 0 in 0.441s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-0f0dbe74-bd18-4981-9083-09bdcd03a63b" released by "delete_volume" :: held 1.020s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:50 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.357s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Deleted volume successfully. Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-edb9b7be-d76d-4037-abfe-ea19efaabcca tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-5ead234c-54d4-488a-82ba-cc76a209d050-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Created reservations ['2209a1d3-4894-416e-bf96-b1cbd95b5ab3', 'e0e78eb2-4f0f-4637-ab57-c4c9b6840ce0', '31cc7652-b130-44e4-ae47-e57dca554aba', '604f0bbb-b9fe-4feb-86a0-69489a64ea62'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:50 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 Nov 01 09:54:50 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:50 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.info" returned: 0 in 0.374s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.717s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7b355cc2-a57a-4b35-925d-4ac1e442e1a7 tempest-CinderUnicodeTest-1841900889 None] Create snapshot completed successfully Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:50 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:50 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:50 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4" returned: 0 in 0.463s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:50 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4 Nov 01 09:54:50 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:50 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.293s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Deleted volume successfully. Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d76beb86-679d-459b-810c-1636785ed58a tempest-ProjectReaderTests-1292665826 None] Lock "cinder-0f0dbe74-bd18-4981-9083-09bdcd03a63b-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "cinder-b1f14f23-02f1-46f4-8a1d-2e7bd30bd880-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-b1f14f23-02f1-46f4-8a1d-2e7bd30bd880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "cinder-quobyte-c2d928e2-4e14-43ed-b263-3ac1197774eb" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-quobyte-c2d928e2-4e14-43ed-b263-3ac1197774eb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "cinder-quobyte-b1f14f23-02f1-46f4-8a1d-2e7bd30bd880" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-quobyte-b1f14f23-02f1-46f4-8a1d-2e7bd30bd880" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Deleting offline snapshot b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 of volume c2d928e2-4e14-43ed-b263-3ac1197774eb {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] snapshot_file for this snap is: volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:54:50 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-93d1db55-0fb7-422c-97d3-08798dc320b4" returned: 0 in 0.318s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc5c1f-8bf8-43ed-8543-94bc58905a34]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-quobyte-93d1db55-0fb7-422c-97d3-08798dc320b4" released by "delete_volume" :: held 0.861s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Created reservations ['8cfb99a5-8c44-44d9-aeb3-5eafabb4121c', '37daaf0b-2da1-4099-939c-cdff1c2f7773', '7953de43-6fc4-448f-9e24-568bbddb9b94', 'd8bff359-9fb8-487a-adcb-75dac8248654'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:51 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 Nov 01 09:54:51 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:51 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:51 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:51 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880" returned: 0 in 0.473s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d928e2-4e14-43ed-b263-3ac1197774eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:54:51 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.337s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Deleted volume successfully. Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[def7c7ae-6dfd-4054-9bcb-1770facb389c]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:51 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e2960b0a-0f85-473f-8c42-3077f4eb28e4 tempest-CreateVolumesFromSourceVolumeTest-1953914746 None] Lock "cinder-93d1db55-0fb7-422c-97d3-08798dc320b4-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:51 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb Nov 01 09:54:51 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:52 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb" returned: 0 in 0.565s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:52 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 Nov 01 09:54:52 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (8dbf2216-dd60-4d3b-9a2c-3e366c396f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdef6a1-f188-49ed-977b-395e09a617ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdef6a1-f188-49ed-977b-395e09a617ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729804642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010e771c-5e92-4b6a-928d-574c61b87847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:52Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c1029c-6762-43f8-b9d5-a3ab05e8d34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c1029c-6762-43f8-b9d5-a3ab05e8d34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bcbe3a-b1fb-44fe-b1b2-68b6dbd63fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0bcbe3a-b1fb-44fe-b1b2-68b6dbd63fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010e771c-5e92-4b6a-928d-574c61b87847', 'volume_name': 'volume-010e771c-5e92-4b6a-928d-574c61b87847', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560b49f9-adb5-4b6f-ba5c-5626a9f314c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560b49f9-adb5-4b6f-ba5c-5626a9f314c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04f68b0-525e-4a5c-8356-bec054461496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:52 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Volume 010e771c-5e92-4b6a-928d-574c61b87847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010e771c-5e92-4b6a-928d-574c61b87847', 'volume_size': 1} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-729804642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010e771c-5e92-4b6a-928d-574c61b87847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:52Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Creating volume 010e771c-5e92-4b6a-928d-574c61b87847 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:54:52 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:52 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 1073741824 Nov 01 09:54:52 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:52 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880" returned: 0 in 0.493s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:52 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880 Nov 01 09:54:52 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:52 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 1073741824" returned: 0 in 0.598s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:52 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb.b1f14f23-02f1-46f4-8a1d-2e7bd30bd880" returned: 0 in 0.344s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:52 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 Nov 01 09:54:52 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-quobyte-b1f14f23-02f1-46f4-8a1d-2e7bd30bd880" released by "_delete_snapshot" :: held 2.067s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:52 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-quobyte-c2d928e2-4e14-43ed-b263-3ac1197774eb" released by "delete_snapshot" :: held 2.106s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Created reservations ['7905e08c-a5bd-4a98-8975-76920c57b95e', '6e6af405-dcf1-4d9b-bb5c-3c5b6bd74931', '51a63fd2-54a9-4c1a-a8da-bad4fd23c954', '81f4daaa-8268-4375-b629-fbd4b8d7edbc'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:53 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Delete snapshot completed successfully. Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-6801ba0f-7712-48f4-ad6d-c74c6f4a743c tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-b1f14f23-02f1-46f4-8a1d-2e7bd30bd880-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:53 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847" returned: 0 in 0.382s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04f68b0-525e-4a5c-8356-bec054461496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010e771c-5e92-4b6a-928d-574c61b87847', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a2a9d9-d0e8-46ad-aa90-ef7a117032a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:53 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Volume volume-010e771c-5e92-4b6a-928d-574c61b87847 (010e771c-5e92-4b6a-928d-574c61b87847): created successfully Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a2a9d9-d0e8-46ad-aa90-ef7a117032a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (8dbf2216-dd60-4d3b-9a2c-3e366c396f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:53 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-efac2676-3d09-4b0f-8ef8-b14ba4115371 tempest-ProjectReaderTests-1292665826 None] Created volume successfully. Nov 01 09:54:53 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:53 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:53 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.347s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:54:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "cinder-c2d928e2-4e14-43ed-b263-3ac1197774eb-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-c2d928e2-4e14-43ed-b263-3ac1197774eb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "cinder-quobyte-c2d928e2-4e14-43ed-b263-3ac1197774eb" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-quobyte-c2d928e2-4e14-43ed-b263-3ac1197774eb" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76dd60d-f0ce-495e-942e-375723b72647]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Creating offline snapshot a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a of volume 010e771c-5e92-4b6a-928d-574c61b87847 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9a181c-1f60-4d38-8142-5f43f4605215]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:54 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb Nov 01 09:54:54 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:54 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 Nov 01 09:54:54 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:54 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb" returned: 0 in 0.487s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:54 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb Nov 01 09:54:54 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:54 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847" returned: 0 in 0.466s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:54 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a 1G Nov 01 09:54:54 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:55 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-c2d928e2-4e14-43ed-b263-3ac1197774eb" returned: 0 in 0.325s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-quobyte-c2d928e2-4e14-43ed-b263-3ac1197774eb" released by "delete_volume" :: held 0.919s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Created reservations ['f4efd317-a310-4e44-b652-126ba6eb8f77', 'c5d0784a-4019-4c60-b5fc-4d8753fdca58', '05e22da4-82d8-4c1d-af0d-bbba8807c8bc', 'c91f7a6c-ccbf-4d10-a15e-e5f8a4d7b133'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:55 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:55 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:55 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a 1G" returned: 0 in 0.545s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e771c-5e92-4b6a-928d-574c61b87847 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:55 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e771c-5e92-4b6a-928d-574c61b87847 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a Nov 01 09:54:55 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:55 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.327s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Deleted volume successfully. Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-66be3466-2ff3-4099-a711-88d9b95e52e8 tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-c2d928e2-4e14-43ed-b263-3ac1197774eb-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:55 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e771c-5e92-4b6a-928d-574c61b87847 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a" returned: 0 in 0.388s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:55 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a is being set with open permissions: ugo+rw Nov 01 09:54:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:55 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a Nov 01 09:54:55 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:56 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a" returned: 0 in 0.276s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:56 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.info Nov 01 09:54:56 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "cinder-46739e91-e94a-4418-98a1-cba60b375a6e-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-46739e91-e94a-4418-98a1-cba60b375a6e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "cinder-quobyte-46739e91-e94a-4418-98a1-cba60b375a6e" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:56 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.info" returned: 0 in 0.355s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:56 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.info is being set with open permissions: ugo+rw Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-quobyte-46739e91-e94a-4418-98a1-cba60b375a6e" acquired by "delete_volume" :: waited 0.039s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:56 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.info Nov 01 09:54:56 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c11d937-40a2-4330-80f4-1c3a63d807e4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:56 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e Nov 01 09:54:56 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:56 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.info" returned: 0 in 0.282s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.426s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:56 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5e546be5-533b-4aa9-80be-4c2df93a190a tempest-ProjectReaderTests-1292665826 None] Create snapshot completed successfully Nov 01 09:54:57 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e" returned: 0 in 0.507s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:57 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e Nov 01 09:54:57 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:57 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-46739e91-e94a-4418-98a1-cba60b375a6e" returned: 0 in 0.282s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-quobyte-46739e91-e94a-4418-98a1-cba60b375a6e" released by "delete_volume" :: held 0.872s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Created reservations ['8559d13c-5aa2-4dcc-819d-4b72a14af3d8', '4ccf289c-c41e-4a97-91ce-67eaafa4f308', '14dda6cd-02ca-440a-9e5c-8101340aa025', 'a5038283-4b18-4099-81fd-f4e8e6bd4f92'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:57 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:57 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-010e771c-5e92-4b6a-928d-574c61b87847" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-010e771c-5e92-4b6a-928d-574c61b87847" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Deleting offline snapshot a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a of volume 010e771c-5e92-4b6a-928d-574c61b87847 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] snapshot_file for this snap is: volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc227a91-b78c-4f47-965c-d83272554c7e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:57 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a Nov 01 09:54:57 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Flow 'volume_create_manager' (4f8dc146-803a-406d-bb23-922070fb4b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6949b5d9-c319-4f4a-b556-b2532126ab2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6949b5d9-c319-4f4a-b556-b2532126ab2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e81e74f-9f98-4717-b3dd-c80125175350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c7af2874534336accb259c95958ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:58Z,use_quota=True,user_id='4f3fdb69dc964d63bffa2d9de5cb7180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de14da2-185b-46f5-81a7-d42040ba52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de14da2-185b-46f5-81a7-d42040ba52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0b840b-aec1-4e12-bb9d-711f1c4e8d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.image.glance [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Creating Keystone auth plugin from conf {{(pid=86594) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 09:54:58 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.558s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:54:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Deleted volume successfully. Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-8889b48e-b4c2-46cc-8c21-9989fd4f69b7 tempest-CinderUnicodeTest-1841900889 None] Lock "cinder-46739e91-e94a-4418-98a1-cba60b375a6e-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:58 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a" returned: 0 in 0.503s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010e771c-5e92-4b6a-928d-574c61b87847(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed78d87-ccf1-4a8b-a9b8-7717f35e4097]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:58 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 Nov 01 09:54:58 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad0b840b-aec1-4e12-bb9d-711f1c4e8d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e81e74f-9f98-4717-b3dd-c80125175350', 'volume_name': 'volume-0e81e74f-9f98-4717-b3dd-c80125175350', 'volume_size': 1, 'image_id': '80687f25-0713-4abd-9dc1-e9541fd85836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80687f25-0713-4abd-9dc1-e9541fd85836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92148724a79a31f28a369147b00a41d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22c7af2874534336accb259c95958ab0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f588335d515576aa95716e4cf81ba536d2f3aff8c471afadfdcf436c60871128d1cef822d6abfde37fadd6e0ba90bda6f89d3ae73d23ade42d4af3a0633fbc19', 'id': '80687f25-0713-4abd-9dc1-e9541fd85836', 'created_at': datetime.datetime(2026, 11, 1, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80687f25-0713-4abd-9dc1-e9541fd85836/file', 'properties': {}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357c3168-c003-4810-a66e-b40d3e573cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (357c3168-c003-4810-a66e-b40d3e573cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafe6f0f-4b74-4378-855c-8721a06be18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:54:58 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Volume 0e81e74f-9f98-4717-b3dd-c80125175350: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e81e74f-9f98-4717-b3dd-c80125175350', 'volume_size': 1, 'image_id': '80687f25-0713-4abd-9dc1-e9541fd85836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80687f25-0713-4abd-9dc1-e9541fd85836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92148724a79a31f28a369147b00a41d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22c7af2874534336accb259c95958ab0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f588335d515576aa95716e4cf81ba536d2f3aff8c471afadfdcf436c60871128d1cef822d6abfde37fadd6e0ba90bda6f89d3ae73d23ade42d4af3a0633fbc19', 'id': '80687f25-0713-4abd-9dc1-e9541fd85836', 'created_at': datetime.datetime(2026, 11, 1, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80687f25-0713-4abd-9dc1-e9541fd85836/file', 'properties': {}}, 'image_service': } Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Trying to clone 0e81e74f-9f98-4717-b3dd-c80125175350 from image 80687f25-0713-4abd-9dc1-e9541fd85836 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80687f25-0713-4abd-9dc1-e9541fd85836', 'metadata': {}}]). {{(pid=86594) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 09:54:58 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Image download 0.00 MB at 0.00 MB/s Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c13571-b42c-4e54-91b0-dfb94380fa45]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:58 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847" returned: 0 in 0.501s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:58 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a Nov 01 09:54:58 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:58 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD Nov 01 09:54:58 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:59 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:59 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a" returned: 0 in 0.431s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:59 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a Nov 01 09:54:59 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:59 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD Nov 01 09:54:59 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:59 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Temporary image 80687f25-0713-4abd-9dc1-e9541fd85836 is fetched for user 4f3fdb69dc964d63bffa2d9de5cb7180. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 09:54:59 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847.a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a" returned: 0 in 0.304s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a" released by "_delete_snapshot" :: held 1.924s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-010e771c-5e92-4b6a-928d-574c61b87847" released by "delete_snapshot" :: held 1.973s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f359b7-8339-4eb7-923f-c14c1a53d934]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Created reservations ['3447c00a-37e8-46e0-a8aa-58d882fb9760', '8fd68da0-63db-47da-869b-2a811fddde19', 'ada605bc-20d5-4303-b053-5c6d71beb5d9', '1375f0f9-38c2-4d3d-9c3b-205a78717763'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:54:59 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Delete snapshot completed successfully. Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-863a9209-9ca6-4487-90bd-557805c286d2 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-a7671d4e-4e2f-44e4-9c14-7e6ebb5f9c3a-delete_snapshot" released by "delete_snapshot" :: held 2.157s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:54:59 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD Nov 01 09:54:59 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-010e771c-5e92-4b6a-928d-574c61b87847-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-010e771c-5e92-4b6a-928d-574c61b87847-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-010e771c-5e92-4b6a-928d-574c61b87847" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:54:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-010e771c-5e92-4b6a-928d-574c61b87847" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c952aa-bc8d-4c90-9211-37b25588dd77]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:00 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:00 devstack sudo[106482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 Nov 01 09:55:00 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:00 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD Nov 01 09:55:00 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:00 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:54:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e81e74f-9f98-4717-b3dd-c80125175350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c7af2874534336accb259c95958ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:54:58Z,use_quota=True,user_id='4f3fdb69dc964d63bffa2d9de5cb7180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Creating volume 0e81e74f-9f98-4717-b3dd-c80125175350 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:00 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:00 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:00 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 1073741824 Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847" returned: 0 in 0.417s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:00 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:00 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847 Nov 01 09:55:00 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:00 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-010e771c-5e92-4b6a-928d-574c61b87847" returned: 0 in 0.298s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-010e771c-5e92-4b6a-928d-574c61b87847" released by "delete_volume" :: held 0.804s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=237,cinder:UPDATE=327,cinder:INSERT=84,cinder:DELETE=29 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=251,cinder:UPDATE=333,cinder:INSERT=88,cinder:DELETE=29 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Created reservations ['c4434ead-74ee-4848-a6ef-349d26fd2668', '3e8e44ba-360b-4cab-9256-d4f0519d2258', 'f5e97f5c-93f2-4739-a674-27c48a9dab5d', '2ff57f0c-c2d6-44c7-b0bd-2a34ed23a1bc'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:00 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 1073741824" returned: 0 in 0.505s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:00 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:00 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:01 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 Nov 01 09:55:01 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:01 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.336s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:01 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Deleted volume successfully. Nov 01 09:55:01 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350" returned: 0 in 0.311s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-bf3765df-0508-4c96-8e83-735fb658f664 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-010e771c-5e92-4b6a-928d-574c61b87847-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Attempting download of 80687f25-0713-4abd-9dc1-e9541fd85836 ((None, [{'url': 'file:///opt/stack/data/glance/images/80687f25-0713-4abd-9dc1-e9541fd85836', 'metadata': {}}])) to volume 0e81e74f-9f98-4717-b3dd-c80125175350. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776e138-09ea-45b5-894b-fcf392114874]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80687f25-0713-4abd-9dc1-e9541fd85836_an3tw018 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:01 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80687f25-0713-4abd-9dc1-e9541fd85836_an3tw018 Nov 01 09:55:01 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (82a25212-39b1-4c39-9b62-22eb17e53071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4750b7-c9c9-458d-9daa-17421840374b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4750b7-c9c9-458d-9daa-17421840374b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846385343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40997f7b-8803-4928-9e35-2ee422868584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:02Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea57f64a-2578-4a57-92e0-be0ed7cf878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea57f64a-2578-4a57-92e0-be0ed7cf878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:01 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09210380-dcb7-4a52-9b43-fe06cfdd49cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09210380-dcb7-4a52-9b43-fe06cfdd49cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40997f7b-8803-4928-9e35-2ee422868584', 'volume_name': 'volume-40997f7b-8803-4928-9e35-2ee422868584', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503f424e-47d8-48f5-b98f-41a68ca02bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503f424e-47d8-48f5-b98f-41a68ca02bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d411c9b-79a5-4795-a783-6d4fcce7515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:01 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Volume 40997f7b-8803-4928-9e35-2ee422868584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40997f7b-8803-4928-9e35-2ee422868584', 'volume_size': 1} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1846385343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40997f7b-8803-4928-9e35-2ee422868584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a661df10db5240ccb645c08b9ef1b15e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:02Z,use_quota=True,user_id='d9ce2d38d7294941ac5eebb33b14561c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Creating volume 40997f7b-8803-4928-9e35-2ee422868584 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:01 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80687f25-0713-4abd-9dc1-e9541fd85836_an3tw018" returned: 0 in 0.431s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:01 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80687f25-0713-4abd-9dc1-e9541fd85836_an3tw018 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:01 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 1073741824 Nov 01 09:55:01 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:01 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80687f25-0713-4abd-9dc1-e9541fd85836_an3tw018 Nov 01 09:55:01 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:02 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80687f25-0713-4abd-9dc1-e9541fd85836_an3tw018" returned: 1 in 0.391s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80687f25-0713-4abd-9dc1-e9541fd85836_an3tw018' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5de4983-c8dc-42dd-965a-d4c96089f334]: (4, 'raw') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:02 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD Nov 01 09:55:02 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:02 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 1073741824" returned: 0 in 0.586s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:02 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 Nov 01 09:55:02 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:02 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:02 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD Nov 01 09:55:02 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:02 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584" returned: 0 in 0.315s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d411c9b-79a5-4795-a783-6d4fcce7515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40997f7b-8803-4928-9e35-2ee422868584', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa192ee-253d-4889-97c6-188df33f748e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:02 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Volume volume-40997f7b-8803-4928-9e35-2ee422868584 (40997f7b-8803-4928-9e35-2ee422868584): created successfully Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa192ee-253d-4889-97c6-188df33f748e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Flow 'volume_create_manager' (82a25212-39b1-4c39-9b62-22eb17e53071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:02 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fd5c5d73-7379-4336-b754-15004c0fc68e tempest-ProjectReaderTests-1292665826 None] Created volume successfully. Nov 01 09:55:02 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] 80687f25-0713-4abd-9dc1-e9541fd85836 was raw, converting to qcow2 {{(pid=86594) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 09:55:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:02 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 Nov 01 09:55:02 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:03 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350" returned: 0 in 0.512s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80687f25-0713-4abd-9dc1-e9541fd85836_lkvusu7adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:55:03 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:03 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 1G Nov 01 09:55:03 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:03 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 1G" returned: 0 in 0.360s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Downloaded image 80687f25-0713-4abd-9dc1-e9541fd85836 ((None, [{'url': 'file:///opt/stack/data/glance/images/80687f25-0713-4abd-9dc1-e9541fd85836', 'metadata': {}}])) to volume 0e81e74f-9f98-4717-b3dd-c80125175350 successfully. {{(pid=86594) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Temporary image 80687f25-0713-4abd-9dc1-e9541fd85836 for user 4f3fdb69dc964d63bffa2d9de5cb7180 is deleted. {{(pid=86594) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.volume.volume_utils [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Marking volume 0e81e74f-9f98-4717-b3dd-c80125175350 as bootable. {{(pid=86594) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Copying metadata from image 80687f25-0713-4abd-9dc1-e9541fd85836 to 0e81e74f-9f98-4717-b3dd-c80125175350. {{(pid=86594) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Creating volume glance metadata for volume 0e81e74f-9f98-4717-b3dd-c80125175350 backed by image 80687f25-0713-4abd-9dc1-e9541fd85836 with: {'image_id': '80687f25-0713-4abd-9dc1-e9541fd85836', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '92148724a79a31f28a369147b00a41d5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86594) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eafe6f0f-4b74-4378-855c-8721a06be18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e81e74f-9f98-4717-b3dd-c80125175350', 'volume_size': 1, 'image_id': '80687f25-0713-4abd-9dc1-e9541fd85836', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80687f25-0713-4abd-9dc1-e9541fd85836', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92148724a79a31f28a369147b00a41d5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '22c7af2874534336accb259c95958ab0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f588335d515576aa95716e4cf81ba536d2f3aff8c471afadfdcf436c60871128d1cef822d6abfde37fadd6e0ba90bda6f89d3ae73d23ade42d4af3a0633fbc19', 'id': '80687f25-0713-4abd-9dc1-e9541fd85836', 'created_at': datetime.datetime(2026, 11, 1, 8, 54, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 8, 54, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80687f25-0713-4abd-9dc1-e9541fd85836/file', 'properties': {}}, 'image_service': }' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4f7165-9f8d-4501-acd1-daf47b20542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:03 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Volume volume-0e81e74f-9f98-4717-b3dd-c80125175350 (0e81e74f-9f98-4717-b3dd-c80125175350): created successfully Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d4f7165-9f8d-4501-acd1-daf47b20542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Flow 'volume_create_manager' (4f8dc146-803a-406d-bb23-922070fb4b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:03 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2ba6c543-0612-49ca-b08d-efbe8ad4810e tempest-VolumeImageDependencyTests-5526583 None] Created volume successfully. Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Creating offline snapshot 6555b416-37ee-4004-a5a8-152c7231d29a of volume 40997f7b-8803-4928-9e35-2ee422868584 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d68cd-61bf-450c-b026-87c7cb2ed2cd]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:04 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 Nov 01 09:55:04 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:04 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584" returned: 0 in 0.412s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Acquiring lock "cinder-0e81e74f-9f98-4717-b3dd-c80125175350-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:04 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a 1G Nov 01 09:55:04 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Lock "cinder-0e81e74f-9f98-4717-b3dd-c80125175350-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Acquiring lock "cinder-quobyte-0e81e74f-9f98-4717-b3dd-c80125175350" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Lock "cinder-quobyte-0e81e74f-9f98-4717-b3dd-c80125175350" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dd5249-2ef2-49ec-be13-8b804bfac109]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:04 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 Nov 01 09:55:04 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:04 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a 1G" returned: 0 in 0.490s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40997f7b-8803-4928-9e35-2ee422868584 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:04 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40997f7b-8803-4928-9e35-2ee422868584 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a Nov 01 09:55:04 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:05 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350" returned: 0 in 0.445s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:05 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350 Nov 01 09:55:05 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:05 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40997f7b-8803-4928-9e35-2ee422868584 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a" returned: 0 in 0.331s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:05 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a is being set with open permissions: ugo+rw Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:05 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a Nov 01 09:55:05 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:05 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0e81e74f-9f98-4717-b3dd-c80125175350" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Lock "cinder-quobyte-0e81e74f-9f98-4717-b3dd-c80125175350" released by "delete_volume" :: held 0.779s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Created reservations ['b375fd3e-7c2b-4b84-ad8e-b1a09c10b305', 'b22d63a8-6228-4f9f-9e94-ecb402857c36', 'e4294585-19fc-415b-adb6-a767cb9e55f0', '2c7d3d8e-5d68-4523-a07e-2ea626b0a356'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:05 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:05 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:05 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a" returned: 0 in 0.282s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:05 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.info Nov 01 09:55:05 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:05 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.305s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:05 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Deleted volume successfully. Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e424e243-5715-4655-baec-8b551c0cc11b tempest-VolumeImageDependencyTests-5526583 None] Lock "cinder-0e81e74f-9f98-4717-b3dd-c80125175350-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:05 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.info" returned: 0 in 0.318s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:05 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.info is being set with open permissions: ugo+rw Nov 01 09:55:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:05 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.info Nov 01 09:55:05 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:06 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.info" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:06 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-629a9279-ae78-4d73-b929-9224b06f84a1 tempest-ProjectReaderTests-1292665826 None] Create snapshot completed successfully Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-6555b416-37ee-4004-a5a8-152c7231d29a-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-6555b416-37ee-4004-a5a8-152c7231d29a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-40997f7b-8803-4928-9e35-2ee422868584" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-40997f7b-8803-4928-9e35-2ee422868584" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-6555b416-37ee-4004-a5a8-152c7231d29a" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-6555b416-37ee-4004-a5a8-152c7231d29a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Deleting offline snapshot 6555b416-37ee-4004-a5a8-152c7231d29a of volume 40997f7b-8803-4928-9e35-2ee422868584 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] snapshot_file for this snap is: volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[6708039f-463e-4968-b64c-ddd89bc701ea]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:07 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a Nov 01 09:55:07 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:07 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a" returned: 0 in 0.392s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40997f7b-8803-4928-9e35-2ee422868584(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a238864f-dc4b-45a8-9e0d-bb457e3b18dd]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:07 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 Nov 01 09:55:07 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:08 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584" returned: 0 in 0.391s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:08 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a Nov 01 09:55:08 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:08 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a" returned: 0 in 0.392s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:08 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a Nov 01 09:55:08 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:08 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584.6555b416-37ee-4004-a5a8-152c7231d29a" returned: 0 in 0.285s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-6555b416-37ee-4004-a5a8-152c7231d29a" released by "_delete_snapshot" :: held 1.569s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-40997f7b-8803-4928-9e35-2ee422868584" released by "delete_snapshot" :: held 1.591s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:08 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Created reservations ['3f23bc49-0c77-4018-bda4-dfc85bf82e21', 'd4de00a3-3123-4891-a83b-cc7066f0d8cb', '9e5c5f3b-9197-4398-9432-124ab1ebf32d', 'c71baceb-c4ce-4f71-95fe-cd209dbe8488'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:09 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Delete snapshot completed successfully. Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-7a2201fe-9ca0-4f57-b443-8b53d94c8580 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-6555b416-37ee-4004-a5a8-152c7231d29a-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-b6f4a50c-4923-45c3-8a1a-c28cc5e5c20c tempest-ProjectAdminTests-464005803 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9102363586426, 'free_capacity_gb': 1773.9102363586426, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86594) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-40997f7b-8803-4928-9e35-2ee422868584-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-40997f7b-8803-4928-9e35-2ee422868584-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "cinder-quobyte-40997f7b-8803-4928-9e35-2ee422868584" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-40997f7b-8803-4928-9e35-2ee422868584" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[11218a10-7dc1-4395-b213-dd0f143d0358]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:09 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 Nov 01 09:55:09 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:09 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584" returned: 0 in 0.382s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:09 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584 Nov 01 09:55:09 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:10 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-40997f7b-8803-4928-9e35-2ee422868584" returned: 0 in 0.277s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-quobyte-40997f7b-8803-4928-9e35-2ee422868584" released by "delete_volume" :: held 0.757s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Created reservations ['407472e2-ed56-43ba-a9f9-2b9acae2a1df', '1162ab1d-0757-45f7-bb8c-157b267928c4', '7ce77516-7472-4dab-bb83-f7675aab8144', '2bb6b50d-83ee-4495-bf3c-0eeba3119c70'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:10 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:10 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:10 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.345s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:10 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Deleted volume successfully. Nov 01 09:55:10 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b34b1995-5459-4581-b88a-c2b09bf42d34 tempest-ProjectReaderTests-1292665826 None] Lock "cinder-40997f7b-8803-4928-9e35-2ee422868584-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (a59faad4-cd65-4a1e-b8de-ad97ebbb8743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479bfaa4-88ca-48aa-acf1-3ec4386684a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (479bfaa4-88ca-48aa-acf1-3ec4386684a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510125308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c357fe1-4fba-4cd1-9db6-a5d59c1f093a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:14Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece3e737-636c-4bbd-9e48-f3116caef93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece3e737-636c-4bbd-9e48-f3116caef93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37f366e-8b1c-42e1-abaf-ec3caafd08f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37f366e-8b1c-42e1-abaf-ec3caafd08f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c357fe1-4fba-4cd1-9db6-a5d59c1f093a', 'volume_name': 'volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d9e447-226e-4f45-af65-b4df8f29e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d9e447-226e-4f45-af65-b4df8f29e514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16214b2-2384-41b4-9520-73cb84edd531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:13 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Volume 0c357fe1-4fba-4cd1-9db6-a5d59c1f093a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a', 'volume_size': 1} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510125308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c357fe1-4fba-4cd1-9db6-a5d59c1f093a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:14Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Creating volume 0c357fe1-4fba-4cd1-9db6-a5d59c1f093a {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:13 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:13 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:14 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a 1073741824 Nov 01 09:55:14 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:14 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a 1073741824" returned: 0 in 0.532s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:14 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a Nov 01 09:55:14 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:14 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" returned: 0 in 0.295s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16214b2-2384-41b4-9520-73cb84edd531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540ebfc9-664e-46ec-b969-929c886fe454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:14 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Volume volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a (0c357fe1-4fba-4cd1-9db6-a5d59c1f093a): created successfully Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (540ebfc9-664e-46ec-b969-929c886fe454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:14 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (a59faad4-cd65-4a1e-b8de-ad97ebbb8743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:14 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3bfd09ea-c213-4610-807d-06f636a6007d tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:55:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot 634600e3-dd7f-4f11-a53f-66d4637f2462 of volume 0c357fe1-4fba-4cd1-9db6-a5d59c1f093a {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:55:16 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e026ea2a-4525-421b-bc03-6376237e983f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:16 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a Nov 01 09:55:16 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:16 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" returned: 0 in 0.423s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:16 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 1G Nov 01 09:55:16 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:17 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 1G" returned: 0 in 0.420s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:17 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 Nov 01 09:55:17 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:17 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462" returned: 0 in 0.286s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:17 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 is being set with open permissions: ugo+rw Nov 01 09:55:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:17 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 Nov 01 09:55:17 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:17 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462" returned: 0 in 0.245s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:17 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.info Nov 01 09:55:17 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:18 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.info" returned: 0 in 0.270s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:18 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.info is being set with open permissions: ugo+rw Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:18 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.info Nov 01 09:55:18 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:18 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.info" returned: 0 in 0.278s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-146305ed-9cbf-4ac3-b938-305e149770f1 tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-634600e3-dd7f-4f11-a53f-66d4637f2462-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Lock "cinder-634600e3-dd7f-4f11-a53f-66d4637f2462-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-634600e3-dd7f-4f11-a53f-66d4637f2462" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-634600e3-dd7f-4f11-a53f-66d4637f2462" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot 634600e3-dd7f-4f11-a53f-66d4637f2462 of volume 0c357fe1-4fba-4cd1-9db6-a5d59c1f093a {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d6d1e2-a4b0-47f3-b3eb-eee5ec332126]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:18 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 Nov 01 09:55:18 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:19 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462" returned: 0 in 0.404s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:55:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[77767102-0d3d-4982-99d3-638cf209dc69]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:19 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a Nov 01 09:55:19 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:19 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" returned: 0 in 0.375s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:19 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 Nov 01 09:55:19 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:19 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462" returned: 0 in 0.366s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:20 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462 Nov 01 09:55:20 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:20 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a.634600e3-dd7f-4f11-a53f-66d4637f2462" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-634600e3-dd7f-4f11-a53f-66d4637f2462" released by "_delete_snapshot" :: held 1.559s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" released by "delete_snapshot" :: held 1.588s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Created reservations ['f3c3c94f-afe7-4d32-b7e5-a27e4a19aa72', '3141d3ea-1023-4fcb-acd5-15ee3c2c19f3', 'dfcb7470-9e42-4657-88e8-af0f79b32c90', 'c8e43355-4ec8-4ad5-955e-d0c7a3e20290'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a9faf81d-b1b2-4242-ba43-7335cfe4667f tempest-ProjectMemberTests-1908354832 None] Lock "cinder-634600e3-dd7f-4f11-a53f-66d4637f2462-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa077844-697e-4f05-bc23-f7753bad7d44]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:21 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a Nov 01 09:55:21 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:21 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" returned: 0 in 0.435s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:21 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a Nov 01 09:55:21 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:21 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" returned: 0 in 0.299s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a" released by "delete_volume" :: held 0.822s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Created reservations ['72409ffe-571d-444b-9fd8-965eccf3c705', '4bb12e6b-7796-4101-84a1-bfead9746818', 'b65d74e2-06b4-47d1-b74b-54fa98f39dd7', '0490906c-3043-4c2d-9616-71b22455a908'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:22 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:22 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:22 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.318s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3b5fe4e5-e246-4291-86e2-c3ae22a34942 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-0c357fe1-4fba-4cd1-9db6-a5d59c1f093a-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (e22146b6-5924-4312-8962-b307c6e92e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a914879-2134-41ae-9def-2b0f9482a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a914879-2134-41ae-9def-2b0f9482a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81520036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3009dc5c-be77-494f-8b5c-89865936e95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:23Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057ac47d-18de-4143-aa60-474a4def9248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057ac47d-18de-4143-aa60-474a4def9248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94314547-7c8c-4df8-97ed-877f3cda0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94314547-7c8c-4df8-97ed-877f3cda0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3009dc5c-be77-494f-8b5c-89865936e95f', 'volume_name': 'volume-3009dc5c-be77-494f-8b5c-89865936e95f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49968e65-e1fd-47b1-9bbd-6cac49594ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49968e65-e1fd-47b1-9bbd-6cac49594ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014ab811-8bea-4d46-9fbc-c52277f741d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:22 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Volume 3009dc5c-be77-494f-8b5c-89865936e95f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3009dc5c-be77-494f-8b5c-89865936e95f', 'volume_size': 1} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81520036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3009dc5c-be77-494f-8b5c-89865936e95f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:23Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Creating volume 3009dc5c-be77-494f-8b5c-89865936e95f {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:22 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:22 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f 1073741824 Nov 01 09:55:22 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:23 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f 1073741824" returned: 0 in 0.477s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:23 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f Nov 01 09:55:23 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:23 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f" returned: 0 in 0.298s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014ab811-8bea-4d46-9fbc-c52277f741d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3009dc5c-be77-494f-8b5c-89865936e95f', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fdf55d-3754-4740-9ebf-8b20430ce4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Volume volume-3009dc5c-be77-494f-8b5c-89865936e95f (3009dc5c-be77-494f-8b5c-89865936e95f): created successfully Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25fdf55d-3754-4740-9ebf-8b20430ce4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (e22146b6-5924-4312-8962-b307c6e92e5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:23 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a1c1b79f-5fe3-41f3-87c9-3506a2ea59e4 tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Flow 'volume_create_manager' (10545758-bc24-4d0f-a3e3-36202b588fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54fec938-4431-4604-a927-fa0d1d28b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54fec938-4431-4604-a927-fa0d1d28b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300838123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650157f5-d0b6-4ca6-ac78-f508d504fbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd5864e971a4e39a264821cb72b8ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:24Z,use_quota=True,user_id='3857eaef511544ffbfc206c354eae8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ac2074-fb24-4c41-8a85-90934c53911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ac2074-fb24-4c41-8a85-90934c53911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ad65be-54ee-4fb2-ba11-c0a3b06e7574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ad65be-54ee-4fb2-ba11-c0a3b06e7574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650157f5-d0b6-4ca6-ac78-f508d504fbeb', 'volume_name': 'volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e6b044-be40-48cb-897e-efc8a440245d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e6b044-be40-48cb-897e-efc8a440245d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e9b754-2ec3-4015-8b2f-b9e79d250f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:24 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Volume 650157f5-d0b6-4ca6-ac78-f508d504fbeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb', 'volume_size': 1} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300838123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650157f5-d0b6-4ca6-ac78-f508d504fbeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd5864e971a4e39a264821cb72b8ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:24Z,use_quota=True,user_id='3857eaef511544ffbfc206c354eae8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Creating volume 650157f5-d0b6-4ca6-ac78-f508d504fbeb {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:24 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:24 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb 1073741824 Nov 01 09:55:24 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:24 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb 1073741824" returned: 0 in 0.534s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:25 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb Nov 01 09:55:25 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:25 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb" returned: 0 in 0.253s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.323s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5e9b754-2ec3-4015-8b2f-b9e79d250f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc7ee3f-4554-418f-80ab-ebe176743657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 of volume 3009dc5c-be77-494f-8b5c-89865936e95f {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:55:25 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Volume volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb (650157f5-d0b6-4ca6-ac78-f508d504fbeb): created successfully Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc7ee3f-4554-418f-80ab-ebe176743657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Flow 'volume_create_manager' (10545758-bc24-4d0f-a3e3-36202b588fc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[2397eb0b-42ff-4d25-90cc-f82d888667b2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:25 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-fb1abf54-4dac-420d-93c3-1041ac83c3c0 tempest-ProjectReaderTests-1894617772 None] Created volume successfully. Nov 01 09:55:25 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f Nov 01 09:55:25 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:25 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f" returned: 0 in 0.396s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:25 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 1G Nov 01 09:55:25 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:26 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 1G" returned: 0 in 0.419s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3009dc5c-be77-494f-8b5c-89865936e95f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:26 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3009dc5c-be77-494f-8b5c-89865936e95f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 Nov 01 09:55:26 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:26 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3009dc5c-be77-494f-8b5c-89865936e95f -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1" returned: 0 in 0.318s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:26 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 is being set with open permissions: ugo+rw Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:26 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 Nov 01 09:55:26 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:26 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1" returned: 0 in 0.263s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Acquiring lock "cinder-650157f5-d0b6-4ca6-ac78-f508d504fbeb-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Lock "cinder-650157f5-d0b6-4ca6-ac78-f508d504fbeb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:26 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.info Nov 01 09:55:26 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Acquiring lock "cinder-quobyte-650157f5-d0b6-4ca6-ac78-f508d504fbeb" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Lock "cinder-quobyte-650157f5-d0b6-4ca6-ac78-f508d504fbeb" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[69863b33-a7d5-42d6-96db-adba0645e3f2]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:27 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb Nov 01 09:55:27 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:27 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.info" returned: 0 in 0.330s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:27 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.info is being set with open permissions: ugo+rw Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:27 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.info Nov 01 09:55:27 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:27 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb" returned: 0 in 0.433s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:27 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.info" returned: 0 in 0.270s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:27 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb Nov 01 09:55:27 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:27 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-68b687c8-83aa-4695-b340-d947df79a832 tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:55:27 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-650157f5-d0b6-4ca6-ac78-f508d504fbeb" returned: 0 in 0.274s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Lock "cinder-quobyte-650157f5-d0b6-4ca6-ac78-f508d504fbeb" released by "delete_volume" :: held 0.761s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Created reservations ['da80c7a2-6751-4899-8601-42f194527dff', '8bd4d909-f05e-4ccd-9eb5-462356bc4bac', '468daff1-5804-45ac-927c-911b4e388d5c', 'f35a2111-050e-40f4-8c57-e815b81624b7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:27 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:27 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:28 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:28 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Deleted volume successfully. Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-b6b03ef1-8628-4653-bb33-744e2f2a75f8 tempest-ProjectReaderTests-1894617772 None] Lock "cinder-650157f5-d0b6-4ca6-ac78-f508d504fbeb-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-3009dc5c-be77-494f-8b5c-89865936e95f" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-3009dc5c-be77-494f-8b5c-89865936e95f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 of volume 3009dc5c-be77-494f-8b5c-89865936e95f {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3a3a22-36aa-4a3d-9e53-7ead03288de4]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:28 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 Nov 01 09:55:28 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Flow 'volume_create_manager' (aa3bcfea-8ef9-437c-9ac0-6d65707a6b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6002198-488c-4f8b-bcb8-20bce82d00ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6002198-488c-4f8b-bcb8-20bce82d00ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1228869953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad131e5-5c16-4a87-917f-b87a3a09f4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd5864e971a4e39a264821cb72b8ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:28Z,use_quota=True,user_id='3857eaef511544ffbfc206c354eae8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57d7da7-0843-4a76-b87b-fb666e9bad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b57d7da7-0843-4a76-b87b-fb666e9bad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347e9083-922c-4a14-a129-31b7489ea8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347e9083-922c-4a14-a129-31b7489ea8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad131e5-5c16-4a87-917f-b87a3a09f4e9', 'volume_name': 'volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610935eb-dc07-4eb2-8d6d-59dee2d2130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (610935eb-dc07-4eb2-8d6d-59dee2d2130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de13574-d644-4a47-9453-0dc99d501c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:28 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Volume bad131e5-5c16-4a87-917f-b87a3a09f4e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9', 'volume_size': 1} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1228869953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad131e5-5c16-4a87-917f-b87a3a09f4e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd5864e971a4e39a264821cb72b8ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:28Z,use_quota=True,user_id='3857eaef511544ffbfc206c354eae8ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Creating volume bad131e5-5c16-4a87-917f-b87a3a09f4e9 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:28 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:28 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 1073741824 Nov 01 09:55:28 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:28 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1" returned: 0 in 0.444s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3009dc5c-be77-494f-8b5c-89865936e95f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[975a16c3-faa4-47b2-90be-2d230c7ac37a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:28 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f Nov 01 09:55:28 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:29 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 1073741824" returned: 0 in 0.488s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:29 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f" returned: 0 in 0.410s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:29 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 Nov 01 09:55:29 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:29 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 Nov 01 09:55:29 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:29 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9" returned: 0 in 0.262s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5de13574-d644-4a47-9453-0dc99d501c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ee8c52-2f80-430e-8546-c91981d24783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:29 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Volume volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 (bad131e5-5c16-4a87-917f-b87a3a09f4e9): created successfully Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ee8c52-2f80-430e-8546-c91981d24783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Flow 'volume_create_manager' (aa3bcfea-8ef9-437c-9ac0-6d65707a6b00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-8c37097e-eb68-453c-9bc7-cd64eebd727c tempest-ProjectReaderTests-1894617772 None] Created volume successfully. Nov 01 09:55:29 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1" returned: 0 in 0.391s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:29 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1 Nov 01 09:55:29 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:29 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f.fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1" returned: 0 in 0.270s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1" released by "_delete_snapshot" :: held 1.646s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-3009dc5c-be77-494f-8b5c-89865936e95f" released by "delete_snapshot" :: held 1.672s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Created reservations ['3edcdf21-db1f-40c9-99e1-778f60de55f9', 'ec18bcf5-6cf9-4d7d-85c3-c3df0494da78', 'fd6046c7-df3d-4133-9673-e44cb82d7b75', '3622c25c-3c6e-4c8f-99c9-9c1f3e8df077'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:55:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4b09aa9b-d8c6-4910-a5d0-0a0c56fa6168 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-fa5ef488-ee29-46c4-b0bb-8bdc8dd53df1-delete_snapshot" released by "delete_snapshot" :: held 1.830s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Flow 'volume_create_manager' (48c0e028-8f7e-4d62-a311-3af8a860eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c31dd2-1dc1-4d3f-a7f5-a8a95a2c1b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c31dd2-1dc1-4d3f-a7f5-a8a95a2c1b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700757133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1f5b9f-cb80-4bc8-9855-074fccbd8044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43f5280287945eaa9e7fa66f84d57b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:30Z,use_quota=True,user_id='05568a11e7874ce38f45f72eef4b4de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9b4af9-ff6c-4226-8e3c-8b3c3365afb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9b4af9-ff6c-4226-8e3c-8b3c3365afb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25aea1a3-2c2c-4d59-954e-72bfd84a9247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25aea1a3-2c2c-4d59-954e-72bfd84a9247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1f5b9f-cb80-4bc8-9855-074fccbd8044', 'volume_name': 'volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc3c2be-38dd-4a39-93c7-7e41cd01f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc3c2be-38dd-4a39-93c7-7e41cd01f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9786d5d-d2df-4d58-baf7-b93ed28ef404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:30 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Volume ad1f5b9f-cb80-4bc8-9855-074fccbd8044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044', 'volume_size': 1} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700757133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1f5b9f-cb80-4bc8-9855-074fccbd8044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43f5280287945eaa9e7fa66f84d57b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:30Z,use_quota=True,user_id='05568a11e7874ce38f45f72eef4b4de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Creating volume ad1f5b9f-cb80-4bc8-9855-074fccbd8044 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:30 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:30 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 1073741824 Nov 01 09:55:30 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-3009dc5c-be77-494f-8b5c-89865936e95f-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Lock "cinder-3009dc5c-be77-494f-8b5c-89865936e95f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-3009dc5c-be77-494f-8b5c-89865936e95f" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-3009dc5c-be77-494f-8b5c-89865936e95f" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1310aa5d-9ce1-4195-9084-d5380d992910]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:30 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f Nov 01 09:55:30 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Acquiring lock "cinder-bad131e5-5c16-4a87-917f-b87a3a09f4e9-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Lock "cinder-bad131e5-5c16-4a87-917f-b87a3a09f4e9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Acquiring lock "cinder-quobyte-bad131e5-5c16-4a87-917f-b87a3a09f4e9" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Lock "cinder-quobyte-bad131e5-5c16-4a87-917f-b87a3a09f4e9" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2c0d41-2a90-4c68-a79c-8badee7f3400]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:30 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 1073741824" returned: 0 in 0.577s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:30 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 Nov 01 09:55:30 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:30 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 Nov 01 09:55:30 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:30 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f" returned: 0 in 0.443s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:30 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f Nov 01 09:55:30 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:31 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9786d5d-d2df-4d58-baf7-b93ed28ef404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6106aa-233c-4e52-b1da-b12d6ebe8f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:31 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Volume volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 (ad1f5b9f-cb80-4bc8-9855-074fccbd8044): created successfully Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6106aa-233c-4e52-b1da-b12d6ebe8f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Flow 'volume_create_manager' (48c0e028-8f7e-4d62-a311-3af8a860eec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:31 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9" returned: 0 in 0.401s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-46159d53-4cb5-4e11-a9d5-e033f859ec31 tempest-ProjectReaderTests-927020940 None] Created volume successfully. Nov 01 09:55:31 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-3009dc5c-be77-494f-8b5c-89865936e95f" returned: 0 in 0.283s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:31 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9 Nov 01 09:55:31 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-3009dc5c-be77-494f-8b5c-89865936e95f" released by "delete_volume" :: held 0.805s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Created reservations ['8ec6338a-2abf-498b-a54a-4aea0eaa9726', '54c2d25f-ec17-486a-9016-10098986ba5b', 'b691db5f-6e72-42b3-b776-a3b4fdcb69dd', 'a0b9d825-6cb4-4f00-8212-2a62461bc1b8'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:31 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:31 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:31 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-bad131e5-5c16-4a87-917f-b87a3a09f4e9" returned: 0 in 0.260s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Lock "cinder-quobyte-bad131e5-5c16-4a87-917f-b87a3a09f4e9" released by "delete_volume" :: held 0.721s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Created reservations ['bb37c448-be40-43b5-90a2-dcd72bd41742', 'f46e85e3-2267-4179-91ef-8da7b1f6e9dd', '60e99c6a-daa1-4e50-92fd-f1911d19d327', '891f568f-2c5e-4867-8f67-6f4e0be13465'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:31 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:31 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:31 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-1ef4544a-89c9-4eba-8faf-4f4778cc168a tempest-ProjectMemberTests-1908354832 None] Lock "cinder-3009dc5c-be77-494f-8b5c-89865936e95f-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:31 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.280s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:31 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Deleted volume successfully. Nov 01 09:55:31 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-9f6cadb9-09de-4e46-985f-9478e250c348 tempest-ProjectReaderTests-1894617772 None] Lock "cinder-bad131e5-5c16-4a87-917f-b87a3a09f4e9-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (9cfac6c8-648a-4158-9b2b-b126c761ef5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf04dde-a134-4a37-be6a-01e1bd6d175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf04dde-a134-4a37-be6a-01e1bd6d175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911860816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:32Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58f95b2-a695-4533-822b-984b759fd34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58f95b2-a695-4533-822b-984b759fd34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a194cf-39b3-4d96-b311-609e633f37e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a194cf-39b3-4d96-b311-609e633f37e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4', 'volume_name': 'volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57651097-9b5f-4f3c-8417-be16a20b1dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57651097-9b5f-4f3c-8417-be16a20b1dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a24eb66-7e8e-41c0-90ed-9f5dbdcc607e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:32 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Volume 1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4', 'volume_size': 1} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-911860816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:32Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Creating volume 1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:32 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:32 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 1073741824 Nov 01 09:55:32 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Acquiring lock "cinder-ad1f5b9f-cb80-4bc8-9855-074fccbd8044-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Lock "cinder-ad1f5b9f-cb80-4bc8-9855-074fccbd8044-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:32 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 1073741824" returned: 0 in 0.508s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Acquiring lock "cinder-quobyte-ad1f5b9f-cb80-4bc8-9855-074fccbd8044" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Lock "cinder-quobyte-ad1f5b9f-cb80-4bc8-9855-074fccbd8044" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274da4e-5b69-44b6-9fbe-0c96caa07cbc]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:32 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 Nov 01 09:55:32 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:32 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 Nov 01 09:55:32 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:32 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a24eb66-7e8e-41c0-90ed-9f5dbdcc607e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a917e9-5248-4ef7-b788-e2dd5baad790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:33 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Volume volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 (1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4): created successfully Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a917e9-5248-4ef7-b788-e2dd5baad790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (9cfac6c8-648a-4158-9b2b-b126c761ef5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-088f5963-4956-4f14-96c6-1713ce9cfd55 tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:55:33 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044" returned: 0 in 0.420s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:33 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044 Nov 01 09:55:33 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:33 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ad1f5b9f-cb80-4bc8-9855-074fccbd8044" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Lock "cinder-quobyte-ad1f5b9f-cb80-4bc8-9855-074fccbd8044" released by "delete_volume" :: held 0.728s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Created reservations ['64205083-d7ef-473d-b307-f4a60f040652', 'e665e31b-634a-41f8-9051-a97b665a3f6c', '2397dfbb-5b7f-405c-a4d3-8798c55de0e9', 'b561b6fa-dd78-4e18-bdb7-39b35a2e7277'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:33 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:33 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:33 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.269s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:33 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Deleted volume successfully. Nov 01 09:55:33 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-045720a2-a4e4-47b0-ab94-122a80f5b7a2 tempest-ProjectReaderTests-927020940 None] Lock "cinder-ad1f5b9f-cb80-4bc8-9855-074fccbd8044-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Flow 'volume_create_manager' (2db360de-29bc-4457-8a2e-9339511789f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5a104c-2476-49b2-9602-2ded61656cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5a104c-2476-49b2-9602-2ded61656cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1542225774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43f5280287945eaa9e7fa66f84d57b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:34Z,use_quota=True,user_id='05568a11e7874ce38f45f72eef4b4de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76d8f59-e9e0-4b3d-b113-e1444dd5c501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c76d8f59-e9e0-4b3d-b113-e1444dd5c501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2438efa-d7b5-4b5d-970b-4ab395ebc4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2438efa-d7b5-4b5d-970b-4ab395ebc4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8', 'volume_name': 'volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504851b1-2f53-474e-a513-4ac7e052af25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504851b1-2f53-474e-a513-4ac7e052af25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0667d7c9-a0b9-4b2b-bbdc-59b59dd4e047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:34 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Volume ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8', 'volume_size': 1} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1542225774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43f5280287945eaa9e7fa66f84d57b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:34Z,use_quota=True,user_id='05568a11e7874ce38f45f72eef4b4de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Creating volume ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:34 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:34 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 1073741824 Nov 01 09:55:34 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:34 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 1073741824" returned: 0 in 0.464s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:34 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 Nov 01 09:55:34 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:35 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8" returned: 0 in 0.260s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.729s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0667d7c9-a0b9-4b2b-bbdc-59b59dd4e047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7faa8ba0-e20d-4b71-affa-c09a7c728d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot f87751f9-30b7-4fed-8e4b-d85e66777cc0 of volume 1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:55:35 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Volume volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 (ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8): created successfully Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7faa8ba0-e20d-4b71-affa-c09a7c728d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Flow 'volume_create_manager' (2db360de-29bc-4457-8a2e-9339511789f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9162cd08-e9e8-4eed-89e9-79d6a0ea1e73]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:35 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-509073dd-bd83-4cc3-aaf1-99e15e24683e tempest-ProjectReaderTests-927020940 None] Created volume successfully. Nov 01 09:55:35 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 Nov 01 09:55:35 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:35 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" returned: 0 in 0.375s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:35 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 1G Nov 01 09:55:35 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:35 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 1G" returned: 0 in 0.440s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:36 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 Nov 01 09:55:36 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:36 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0" returned: 0 in 0.331s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:36 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 is being set with open permissions: ugo+rw Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:36 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 Nov 01 09:55:36 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Acquiring lock "cinder-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Lock "cinder-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Acquiring lock "cinder-quobyte-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Lock "cinder-quobyte-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba595c14-201d-4551-8ba7-99c42ddb132a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:36 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0" returned: 0 in 0.299s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:36 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 Nov 01 09:55:36 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:36 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.info Nov 01 09:55:36 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:36 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.info" returned: 0 in 0.264s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:36 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.info is being set with open permissions: ugo+rw Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:36 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8" returned: 0 in 0.423s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:36 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.info Nov 01 09:55:36 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:36 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8 Nov 01 09:55:36 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:37 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.info" returned: 0 in 0.280s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:37 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8" returned: 0 in 0.288s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Lock "cinder-quobyte-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8" released by "delete_volume" :: held 0.781s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3c30cefa-6129-4c02-89e4-a85dd6291ad3 tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Created reservations ['c87bed20-3ab5-418d-acc3-a5d7c02acc8c', '6eb184da-790d-40a6-aa42-07e130103b45', 'df3616a2-9cff-4d82-8889-4065ee34e714', '21ec439d-541e-4cf3-9624-59fabac14ff1'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:37 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:37 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-f87751f9-30b7-4fed-8e4b-d85e66777cc0-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-f87751f9-30b7-4fed-8e4b-d85e66777cc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-f87751f9-30b7-4fed-8e4b-d85e66777cc0" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-f87751f9-30b7-4fed-8e4b-d85e66777cc0" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot f87751f9-30b7-4fed-8e4b-d85e66777cc0 of volume 1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:55:37 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.310s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08bfbdc-704c-4c81-b383-1bdc1e8fc7be]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Deleted volume successfully. Nov 01 09:55:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5d3a45e3-6755-49f4-9ce3-8b3fbc56835e tempest-ProjectReaderTests-927020940 None] Lock "cinder-ddfdd854-9b6e-47a0-a89f-7573a8fbbfc8-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:37 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 Nov 01 09:55:37 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:38 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Flow 'volume_create_manager' (38359676-f1e2-4baa-a91e-f9e63fb48fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319484de-0491-4919-ba41-6f201322af9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0" returned: 0 in 0.487s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319484de-0491-4919-ba41-6f201322af9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1777960566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f94d1f-f375-45b9-bb38-7fbaa06f41a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43f5280287945eaa9e7fa66f84d57b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:38Z,use_quota=True,user_id='05568a11e7874ce38f45f72eef4b4de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1401e0-991d-43d0-a5af-7563906d47f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1401e0-991d-43d0-a5af-7563906d47f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4102e1-02bb-4952-8631-60b72f4d0dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4102e1-02bb-4952-8631-60b72f4d0dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f94d1f-f375-45b9-bb38-7fbaa06f41a0', 'volume_name': 'volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ee93d4-3d84-491e-93f7-f690582873e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ee93d4-3d84-491e-93f7-f690582873e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94c5d11-75c1-4458-a44f-a5e35f827b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:38 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Volume 35f94d1f-f375-45b9-bb38-7fbaa06f41a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0', 'volume_size': 1} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1777960566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f94d1f-f375-45b9-bb38-7fbaa06f41a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43f5280287945eaa9e7fa66f84d57b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:38Z,use_quota=True,user_id='05568a11e7874ce38f45f72eef4b4de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Creating volume 35f94d1f-f375-45b9-bb38-7fbaa06f41a0 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:38 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c878bb-3f4e-4048-b5f4-ff107d0c6630]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:38 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 1073741824 Nov 01 09:55:38 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:38 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 Nov 01 09:55:38 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:38 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" returned: 0 in 0.452s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:38 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 1073741824" returned: 0 in 0.491s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:38 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 Nov 01 09:55:38 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:38 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:38 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 Nov 01 09:55:38 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:39 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0" returned: 0 in 0.280s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94c5d11-75c1-4458-a44f-a5e35f827b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a961e849-86b3-4e38-a60e-b7c9a8db9fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:39 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Volume volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 (35f94d1f-f375-45b9-bb38-7fbaa06f41a0): created successfully Nov 01 09:55:39 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a961e849-86b3-4e38-a60e-b7c9a8db9fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Flow 'volume_create_manager' (38359676-f1e2-4baa-a91e-f9e63fb48fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0" returned: 0 in 0.390s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ec709b40-2a3f-4193-86a4-4f8ab335adac tempest-ProjectReaderTests-927020940 None] Created volume successfully. Nov 01 09:55:39 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0 Nov 01 09:55:39 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:39 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4.f87751f9-30b7-4fed-8e4b-d85e66777cc0" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-f87751f9-30b7-4fed-8e4b-d85e66777cc0" released by "_delete_snapshot" :: held 1.787s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" released by "delete_snapshot" :: held 1.837s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Created reservations ['cb1e10c5-e6ce-4392-9e5d-c142676eaf3d', '7b17b75f-f6cd-4fd2-9807-497b04c4bb73', '41b35c25-d707-434c-b1dd-b37adcc5dd10', '05d2e8aa-bf29-49a6-a079-09a2f38206f7'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:39 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ed18a7f0-8030-4b33-b702-c787dd6e9a98 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-f87751f9-30b7-4fed-8e4b-d85e66777cc0-delete_snapshot" released by "delete_snapshot" :: held 1.985s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Lock "cinder-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" acquired by "delete_volume" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6bac0c-f224-41d4-a7c3-88f3eda9069a]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:39 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:39 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 Nov 01 09:55:39 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:40 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" returned: 0 in 0.418s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:40 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4 Nov 01 09:55:40 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Acquiring lock "cinder-35f94d1f-f375-45b9-bb38-7fbaa06f41a0-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Lock "cinder-35f94d1f-f375-45b9-bb38-7fbaa06f41a0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Acquiring lock "cinder-quobyte-35f94d1f-f375-45b9-bb38-7fbaa06f41a0" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Lock "cinder-quobyte-35f94d1f-f375-45b9-bb38-7fbaa06f41a0" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6c2312-fddf-4aa6-b4fd-bdd4faa9c1b8]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:40 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" returned: 0 in 0.301s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:40 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 Nov 01 09:55:40 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4" released by "delete_volume" :: held 0.817s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Created reservations ['b19870d1-7deb-41e3-ad5a-6b13cca84cfe', 'b3f9cb29-7290-4668-b5fd-b6a6063a1b9e', '0675587c-e12f-48df-9dda-af02608d2d3b', 'a31874ce-ed8f-434a-a246-7896d94536b5'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:40 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:40 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:40 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0" returned: 0 in 0.453s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:40 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:40 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0 Nov 01 09:55:40 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:41 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.325s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-26cc7f24-5447-4edb-a678-c3c15dddeadf tempest-ProjectMemberTests-1908354832 None] Lock "cinder-1c2fb467-b6a0-4578-a5ba-4048bf8dc5c4-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:41 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-35f94d1f-f375-45b9-bb38-7fbaa06f41a0" returned: 0 in 0.299s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Lock "cinder-quobyte-35f94d1f-f375-45b9-bb38-7fbaa06f41a0" released by "delete_volume" :: held 0.812s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Created reservations ['550135bf-c10c-4441-b8af-a112b65577e9', '1e6d9ef4-1ce5-4847-b541-e4613026d075', 'eab24539-a89e-4355-9acf-2c29774ba66d', 'eeb34a94-8d84-40ad-8646-b57d96d87f75'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:41 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:41 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (183dbeeb-44f2-4a92-8c63-aea4eaecffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16aed2d3-20d5-4742-abf4-a7fe5f37a53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16aed2d3-20d5-4742-abf4-a7fe5f37a53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092647187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f414175-bcf8-4480-a5b3-ff0728d1c0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:41Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a17d2f-2437-4f8f-85e3-3178ffdd1c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7a17d2f-2437-4f8f-85e3-3178ffdd1c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e586f236-fdbc-4e07-aaef-a173a2f08015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e586f236-fdbc-4e07-aaef-a173a2f08015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f414175-bcf8-4480-a5b3-ff0728d1c0dd', 'volume_name': 'volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3371f7ca-dce1-4bb7-bb75-dea2f114bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3371f7ca-dce1-4bb7-bb75-dea2f114bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f735cf-36da-4fd5-b874-f4be8ce11aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:41 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Volume 5f414175-bcf8-4480-a5b3-ff0728d1c0dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd', 'volume_size': 1} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092647187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f414175-bcf8-4480-a5b3-ff0728d1c0dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:41Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Creating volume 5f414175-bcf8-4480-a5b3-ff0728d1c0dd {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:41 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:41 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd 1073741824 Nov 01 09:55:41 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:41 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.330s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:41 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Deleted volume successfully. Nov 01 09:55:41 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-eb4a67ef-922c-4d33-a5e3-4ba657b73026 tempest-ProjectReaderTests-927020940 None] Lock "cinder-35f94d1f-f375-45b9-bb38-7fbaa06f41a0-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Flow 'volume_create_manager' (e6430e80-03b7-4a34-8e93-6f83605ee4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:42 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be77d5c5-c3c5-4cbb-a288-e5408be7c741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd 1073741824" returned: 0 in 0.547s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be77d5c5-c3c5-4cbb-a288-e5408be7c741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904782344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b536fd-d2a8-470c-92cc-58e1ae982f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43f5280287945eaa9e7fa66f84d57b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:42Z,use_quota=True,user_id='05568a11e7874ce38f45f72eef4b4de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f3d675-8971-4bb1-943e-d51547f192ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f3d675-8971-4bb1-943e-d51547f192ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaa0aa5-9f66-4982-8820-51dcf1d3907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaa0aa5-9f66-4982-8820-51dcf1d3907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b536fd-d2a8-470c-92cc-58e1ae982f77', 'volume_name': 'volume-58b536fd-d2a8-470c-92cc-58e1ae982f77', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd59a6db-6bb6-4506-bb57-9aa77d671e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd59a6db-6bb6-4506-bb57-9aa77d671e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444e314f-3f9b-42a2-86cf-001cf9ad88ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:42 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Volume 58b536fd-d2a8-470c-92cc-58e1ae982f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b536fd-d2a8-470c-92cc-58e1ae982f77', 'volume_size': 1} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:42 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd Nov 01 09:55:42 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:42 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" returned: 0 in 0.244s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.272s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904782344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b536fd-d2a8-470c-92cc-58e1ae982f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43f5280287945eaa9e7fa66f84d57b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:42Z,use_quota=True,user_id='05568a11e7874ce38f45f72eef4b4de8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Creating volume 58b536fd-d2a8-470c-92cc-58e1ae982f77 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:42 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:42 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 1073741824 Nov 01 09:55:42 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f735cf-36da-4fd5-b874-f4be8ce11aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fc3421-7432-48ac-ae5f-6a01a15f4058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:42 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Volume volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd (5f414175-bcf8-4480-a5b3-ff0728d1c0dd): created successfully Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fc3421-7432-48ac-ae5f-6a01a15f4058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (183dbeeb-44f2-4a92-8c63-aea4eaecffb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:42 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3687745a-0684-465d-812c-0d989c0c054d tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:55:42 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 1073741824" returned: 0 in 0.431s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:42 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:43 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 Nov 01 09:55:43 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:43 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77" returned: 0 in 0.268s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444e314f-3f9b-42a2-86cf-001cf9ad88ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b536fd-d2a8-470c-92cc-58e1ae982f77', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17840b67-4c5e-4596-bf94-b966b3689760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:43 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Volume volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 (58b536fd-d2a8-470c-92cc-58e1ae982f77): created successfully Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17840b67-4c5e-4596-bf94-b966b3689760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Flow 'volume_create_manager' (e6430e80-03b7-4a34-8e93-6f83605ee4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:43 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-2e7c5db0-8c01-4e6c-b122-725de04831ad tempest-ProjectReaderTests-927020940 None] Created volume successfully. Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot 6580b627-f844-4d23-b83c-a19a5853361f of volume 5f414175-bcf8-4480-a5b3-ff0728d1c0dd {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[99abdba2-7247-47c7-a5a6-881afefb4692]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:43 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:43 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd Nov 01 09:55:43 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:44 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" returned: 0 in 0.407s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:44 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f 1G Nov 01 09:55:44 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Acquiring lock "cinder-58b536fd-d2a8-470c-92cc-58e1ae982f77-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Lock "cinder-58b536fd-d2a8-470c-92cc-58e1ae982f77-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Acquiring lock "cinder-quobyte-58b536fd-d2a8-470c-92cc-58e1ae982f77" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Lock "cinder-quobyte-58b536fd-d2a8-470c-92cc-58e1ae982f77" acquired by "delete_volume" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbf71c2-8d93-4fa5-be5e-4787071dd50b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:44 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 Nov 01 09:55:44 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:44 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f 1G" returned: 0 in 0.497s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:44 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f Nov 01 09:55:44 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:44 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77" returned: 0 in 0.398s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:44 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77 Nov 01 09:55:44 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:44 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f" returned: 0 in 0.324s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:44 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f is being set with open permissions: ugo+rw Nov 01 09:55:44 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:45 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f Nov 01 09:55:45 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:45 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-58b536fd-d2a8-470c-92cc-58e1ae982f77" returned: 0 in 0.273s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Lock "cinder-quobyte-58b536fd-d2a8-470c-92cc-58e1ae982f77" released by "delete_volume" :: held 0.720s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Created reservations ['cd9a2cb4-20c2-4cb3-9e94-d9c9bd7822ed', '605e0e07-3e33-49fe-9e64-c463f0b3c196', 'ab45ebf6-3242-4c8d-b540-390db03051af', '0a0456c9-3c1b-4b19-8efa-4f1f61286517'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:45 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f" returned: 0 in 0.341s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:45 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:45 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:45 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.info Nov 01 09:55:45 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:45 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.385s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:45 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Deleted volume successfully. Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f84e282f-e91d-4c53-aea8-36eb41f00e30 tempest-ProjectReaderTests-927020940 None] Lock "cinder-58b536fd-d2a8-470c-92cc-58e1ae982f77-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:45 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.info" returned: 0 in 0.410s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:45 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.info is being set with open permissions: ugo+rw Nov 01 09:55:45 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:45 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.info Nov 01 09:55:45 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:46 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.info" returned: 0 in 0.307s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:46 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.459s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:46 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-40cf729c-e248-4add-8a34-d62ecceb0e9f tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:55:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-6580b627-f844-4d23-b83c-a19a5853361f-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Lock "cinder-6580b627-f844-4d23-b83c-a19a5853361f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:46 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-6580b627-f844-4d23-b83c-a19a5853361f" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-6580b627-f844-4d23-b83c-a19a5853361f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot 6580b627-f844-4d23-b83c-a19a5853361f of volume 5f414175-bcf8-4480-a5b3-ff0728d1c0dd {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecb97d7-bacc-4eeb-9fde-427a442a4c83]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:47 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f Nov 01 09:55:47 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:47 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f" returned: 0 in 0.393s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d19aca-c04f-4836-8e88-61a997600293]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:47 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd Nov 01 09:55:47 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:47 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" returned: 0 in 0.410s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:47 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:47 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f Nov 01 09:55:47 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:48 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f" returned: 0 in 0.391s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:48 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f Nov 01 09:55:48 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:48 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:48 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd.6580b627-f844-4d23-b83c-a19a5853361f" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-6580b627-f844-4d23-b83c-a19a5853361f" released by "_delete_snapshot" :: held 1.582s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" released by "delete_snapshot" :: held 1.610s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:48 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Created reservations ['c9f6bcaa-512f-4f0a-8b0a-8f6597ab4af5', 'cb691d77-b589-451d-9dcb-3c1ea95b2abf', '522b5698-31ee-46cb-89ca-7dad8be8b512', '66d31a94-ad7f-49b1-b331-438e44363c06'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:48 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:55:48 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-3059b9f5-1871-4fb2-bfa7-eb0f04684f3b tempest-ProjectMemberTests-1908354832 None] Lock "cinder-6580b627-f844-4d23-b83c-a19a5853361f-delete_snapshot" released by "delete_snapshot" :: held 1.774s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-5f414175-bcf8-4480-a5b3-ff0728d1c0dd-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Lock "cinder-5f414175-bcf8-4480-a5b3-ff0728d1c0dd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[905edb51-e560-4e39-929e-ec56a47cf8fe]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:49 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd Nov 01 09:55:49 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:49 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" returned: 0 in 0.431s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:49 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd Nov 01 09:55:49 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:49 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:49 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-5f414175-bcf8-4480-a5b3-ff0728d1c0dd" released by "delete_volume" :: held 0.762s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Created reservations ['500f0e71-091c-4700-b800-29e6bb9cb39d', '1bb2de49-2206-49e5-94aa-1938e72c27ce', '05a241b5-90ee-44f0-a58f-f2b2ced56d89', 'a47267ae-f363-48d8-b31c-adac4a371100'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:50 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:50 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:50 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.255s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:50 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-689554bf-6496-42cf-8ada-dd4a30ce5ddf tempest-ProjectMemberTests-1908354832 None] Lock "cinder-5f414175-bcf8-4480-a5b3-ff0728d1c0dd-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (6306640c-0c6e-4e5f-92d0-937003155a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b569c7-6ee3-4590-936a-eb9b5bca0c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71b569c7-6ee3-4590-936a-eb9b5bca0c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536600070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912b39b5-3561-41d8-b3d0-dc28aac71173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:51Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482d09c3-2b11-4dad-a576-f95d2d874958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (482d09c3-2b11-4dad-a576-f95d2d874958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646178ea-43e6-4019-9be7-99e5ad76e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646178ea-43e6-4019-9be7-99e5ad76e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912b39b5-3561-41d8-b3d0-dc28aac71173', 'volume_name': 'volume-912b39b5-3561-41d8-b3d0-dc28aac71173', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312e0247-3b67-44a6-a852-1b3a23ef9d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (312e0247-3b67-44a6-a852-1b3a23ef9d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d55829d-9eaf-4ff4-80bf-b6084306eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:50 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Volume 912b39b5-3561-41d8-b3d0-dc28aac71173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912b39b5-3561-41d8-b3d0-dc28aac71173', 'volume_size': 1} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-536600070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912b39b5-3561-41d8-b3d0-dc28aac71173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:55:51Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Creating volume 912b39b5-3561-41d8-b3d0-dc28aac71173 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:55:50 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:55:50 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:50 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 1073741824 Nov 01 09:55:50 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:51 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 1073741824" returned: 0 in 0.538s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:51 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 Nov 01 09:55:51 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:51 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173" returned: 0 in 0.300s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d55829d-9eaf-4ff4-80bf-b6084306eafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912b39b5-3561-41d8-b3d0-dc28aac71173', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af37a467-d604-40dc-a944-5facf2d3e287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:55:51 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Volume volume-912b39b5-3561-41d8-b3d0-dc28aac71173 (912b39b5-3561-41d8-b3d0-dc28aac71173): created successfully Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af37a467-d604-40dc-a944-5facf2d3e287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:55:51 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (6306640c-0c6e-4e5f-92d0-937003155a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:55:51 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-da563f18-7c7a-4038-933b-a5e70a7cd5de tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot 6a50ba65-b135-4680-8a0d-e62b0f279a4f of volume 912b39b5-3561-41d8-b3d0-dc28aac71173 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b89b55-a329-4c8c-9ae1-a8848e95dbbc]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:53 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 Nov 01 09:55:53 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:53 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:53 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:53 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173" returned: 0 in 0.400s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:53 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f 1G Nov 01 09:55:53 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:53 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.287s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 09:55:53 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f 1G" returned: 0 in 0.433s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912b39b5-3561-41d8-b3d0-dc28aac71173 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:53 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912b39b5-3561-41d8-b3d0-dc28aac71173 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f Nov 01 09:55:53 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:54 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-912b39b5-3561-41d8-b3d0-dc28aac71173 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f" returned: 0 in 0.328s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:54 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f is being set with open permissions: ugo+rw Nov 01 09:55:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:54 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f Nov 01 09:55:54 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:54 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f" returned: 0 in 0.280s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:54 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.info Nov 01 09:55:54 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:54 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.info" returned: 0 in 0.267s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:54 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.info is being set with open permissions: ugo+rw Nov 01 09:55:54 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:54 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.info Nov 01 09:55:54 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:55 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.info" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:55 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:55 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-dea4738f-9a8f-4f1b-9c8e-efae0e066d1e tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-6a50ba65-b135-4680-8a0d-e62b0f279a4f-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-6a50ba65-b135-4680-8a0d-e62b0f279a4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-912b39b5-3561-41d8-b3d0-dc28aac71173" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-912b39b5-3561-41d8-b3d0-dc28aac71173" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-6a50ba65-b135-4680-8a0d-e62b0f279a4f" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-6a50ba65-b135-4680-8a0d-e62b0f279a4f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot 6a50ba65-b135-4680-8a0d-e62b0f279a4f of volume 912b39b5-3561-41d8-b3d0-dc28aac71173 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd13034-9a2d-4cd0-8bea-31d5f6acb4cb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:56 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f Nov 01 09:55:56 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:56 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f" returned: 0 in 0.452s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-912b39b5-3561-41d8-b3d0-dc28aac71173(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[005ef3a3-1682-416d-8c0f-2277093666a7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:56 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:56 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 Nov 01 09:55:56 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:57 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173" returned: 0 in 0.374s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:57 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f Nov 01 09:55:57 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:57 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f" returned: 0 in 0.360s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:57 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f Nov 01 09:55:57 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:57 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:57 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173.6a50ba65-b135-4680-8a0d-e62b0f279a4f" returned: 0 in 0.253s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-6a50ba65-b135-4680-8a0d-e62b0f279a4f" released by "_delete_snapshot" :: held 1.561s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:57 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-912b39b5-3561-41d8-b3d0-dc28aac71173" released by "delete_snapshot" :: held 1.590s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:57 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Created reservations ['1845ff9e-7b50-41d2-a9f0-21297169b334', '9b9c88fb-6d24-46ef-a4f3-44b769ddb179', '94f47399-e5f1-4fcd-b044-7e67a7726fec', '497788a4-64b1-46f9-a00f-e280c5ca3d1b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:58 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-cb941e5c-8dec-462a-ba37-83351cdfb0b8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-6a50ba65-b135-4680-8a0d-e62b0f279a4f-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-912b39b5-3561-41d8-b3d0-dc28aac71173-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-912b39b5-3561-41d8-b3d0-dc28aac71173-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-912b39b5-3561-41d8-b3d0-dc28aac71173" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-912b39b5-3561-41d8-b3d0-dc28aac71173" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf90b9e3-193f-4805-ad9c-25ba1aa9796e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:58 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 Nov 01 09:55:58 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:58 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173" returned: 0 in 0.421s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:58 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:58 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173 Nov 01 09:55:58 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:59 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-912b39b5-3561-41d8-b3d0-dc28aac71173" returned: 0 in 0.275s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-912b39b5-3561-41d8-b3d0-dc28aac71173" released by "delete_volume" :: held 0.779s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Created reservations ['9f6b155e-950b-4830-8fe3-ebc42b6df505', 'c7443db5-0fe5-4354-9b01-ae8ee90e8727', '4b4da2b2-45c0-43de-ba1e-a8761cf16473', 'f864d2d2-d72a-4b37-94a2-8528cee56508'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:55:59 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:55:59 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:55:59 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.296s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:55:59 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:55:59 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-ea683d90-d34d-4404-9bdd-38949de5a042 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-912b39b5-3561-41d8-b3d0-dc28aac71173-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (9405165a-e287-46f1-b3aa-bbcda13c325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07f1db1-479e-4286-817b-a882071b076c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07f1db1-479e-4286-817b-a882071b076c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-67520753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173bc8ea-f7a0-4c95-8549-ae8af2ac998a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:00Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c73e9a-f2c4-4a3c-a053-896a3ce67750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c73e9a-f2c4-4a3c-a053-896a3ce67750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61eddfe8-241a-454a-abfd-bece680b0412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61eddfe8-241a-454a-abfd-bece680b0412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173bc8ea-f7a0-4c95-8549-ae8af2ac998a', 'volume_name': 'volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f60f30-3a10-4491-b9fe-08c1b144ee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f60f30-3a10-4491-b9fe-08c1b144ee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf64725-ce87-4468-aad2-86256bd674b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:00 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Volume 173bc8ea-f7a0-4c95-8549-ae8af2ac998a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a', 'volume_size': 1} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-67520753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173bc8ea-f7a0-4c95-8549-ae8af2ac998a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:00Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Creating volume 173bc8ea-f7a0-4c95-8549-ae8af2ac998a {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:56:00 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:00 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a 1073741824 Nov 01 09:56:00 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:00 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a 1073741824" returned: 0 in 0.463s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:00 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a Nov 01 09:56:00 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:00 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" returned: 0 in 0.267s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:SELECT=137,cinder:INSERT=55,cinder:UPDATE=192,cinder:DELETE=15 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bf64725-ce87-4468-aad2-86256bd674b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498006ea-a4e2-495b-b13a-a2e1cdba072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=200,cinder:SELECT=152,cinder:INSERT=53,cinder:DELETE=18 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:56:00 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Volume volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a (173bc8ea-f7a0-4c95-8549-ae8af2ac998a): created successfully Nov 01 09:56:00 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498006ea-a4e2-495b-b13a-a2e1cdba072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:01 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (9405165a-e287-46f1-b3aa-bbcda13c325f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:01 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7d3f4586-9258-4238-898d-c412a176afdf tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:56:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:02 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot b94b11d0-cf03-466e-81b3-4fb8d555379d of volume 173bc8ea-f7a0-4c95-8549-ae8af2ac998a {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:56:02 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0c9a3d-c02b-4465-bbe0-f6c4400e73bb]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:02 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a Nov 01 09:56:02 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:02 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" returned: 0 in 0.381s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:02 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:02 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d 1G Nov 01 09:56:02 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:03 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d 1G" returned: 0 in 0.422s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:03 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d Nov 01 09:56:03 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Flow 'volume_create_manager' (088326f6-009d-436e-8c66-c62dce5fdf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bc22ad-6bd4-4767-97b0-9cbe6f33196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5bc22ad-6bd4-4767-97b0-9cbe6f33196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1012141383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6f6d33-bf36-4cb1-949d-ea40c84952ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab522095310d47ed930d4ec7bfc728a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:03Z,use_quota=True,user_id='8946a801dded48e49038e82e35613728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fcba80-b9d8-4758-aca0-d41596ea834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fcba80-b9d8-4758-aca0-d41596ea834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15582414-a5c7-4865-9ac8-7564ec899f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15582414-a5c7-4865-9ac8-7564ec899f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6f6d33-bf36-4cb1-949d-ea40c84952ad', 'volume_name': 'volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b00302c-f121-4c66-a56a-e819a4fe928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b00302c-f121-4c66-a56a-e819a4fe928b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d895d131-e387-4a68-b3e2-1063b6a934f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:03 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Volume 9f6f6d33-bf36-4cb1-949d-ea40c84952ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad', 'volume_size': 1} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:03 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d" returned: 0 in 0.327s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:03 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d is being set with open permissions: ugo+rw Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:03 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d Nov 01 09:56:03 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:03 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:03 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:03 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.info Nov 01 09:56:03 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:04 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.info" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:04 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.info is being set with open permissions: ugo+rw Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:04 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.info Nov 01 09:56:04 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:04 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.info" returned: 0 in 0.249s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.876s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1012141383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6f6d33-bf36-4cb1-949d-ea40c84952ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab522095310d47ed930d4ec7bfc728a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:03Z,use_quota=True,user_id='8946a801dded48e49038e82e35613728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Creating volume 9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:56:04 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:04 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad 1073741824 Nov 01 09:56:04 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:04 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-24464bbd-7f6b-4c60-b948-10f1ac327743 tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:56:04 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad 1073741824" returned: 0 in 0.411s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:04 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:04 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad Nov 01 09:56:04 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:05 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d895d131-e387-4a68-b3e2-1063b6a934f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983ce451-c787-4a16-a5cd-06d45f639007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:05 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Volume volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad (9f6f6d33-bf36-4cb1-949d-ea40c84952ad): created successfully Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (983ce451-c787-4a16-a5cd-06d45f639007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Flow 'volume_create_manager' (088326f6-009d-436e-8c66-c62dce5fdf22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:05 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a1dc3f6a-6eb6-4dba-b3c2-45fe158baa6f tempest-SnapshotDependencyTests-1424281794 None] Created volume successfully. Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-b94b11d0-cf03-466e-81b3-4fb8d555379d-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-b94b11d0-cf03-466e-81b3-4fb8d555379d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-b94b11d0-cf03-466e-81b3-4fb8d555379d" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-b94b11d0-cf03-466e-81b3-4fb8d555379d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot b94b11d0-cf03-466e-81b3-4fb8d555379d of volume 173bc8ea-f7a0-4c95-8549-ae8af2ac998a {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f19839a-86e6-43f6-b697-452670250fab]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:05 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d Nov 01 09:56:05 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Creating offline snapshot 08f35153-b36b-4f76-a9e2-16b0979138b7 of volume 9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57807c4-161d-4432-9e62-6b3ed15be021]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:05 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:05 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad Nov 01 09:56:05 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:06 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d" returned: 0 in 0.369s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03dacd1-6b69-4f96-8c19-06369cd07b3f]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:06 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" returned: 0 in 0.370s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:06 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a Nov 01 09:56:06 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:06 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 1G Nov 01 09:56:06 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:06 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" returned: 0 in 0.374s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:06 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d Nov 01 09:56:06 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:06 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 1G" returned: 0 in 0.433s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:06 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 Nov 01 09:56:06 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:06 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d" returned: 0 in 0.353s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:06 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d Nov 01 09:56:06 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:06 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7" returned: 0 in 0.313s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:06 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 is being set with open permissions: ugo+rw Nov 01 09:56:06 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:06 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 Nov 01 09:56:06 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:07 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a.b94b11d0-cf03-466e-81b3-4fb8d555379d" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-b94b11d0-cf03-466e-81b3-4fb8d555379d" released by "_delete_snapshot" :: held 1.458s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" released by "delete_snapshot" :: held 1.487s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Created reservations ['c84e24ac-68a7-4ff8-bf35-c7cc655dd9a2', '335b6c77-1810-42d4-a083-64678b7a4665', '517be350-28ad-475e-93a0-0f21b394d5d8', '6e9ed0fc-b292-4341-baa7-dbbb7bb802b4'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:07 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:07 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-05ada229-4664-4b8b-a9b1-d388c5f376d7 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-b94b11d0-cf03-466e-81b3-4fb8d555379d-delete_snapshot" released by "delete_snapshot" :: held 1.651s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:07 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.info Nov 01 09:56:07 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:07 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.info" returned: 0 in 0.246s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:07 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.info is being set with open permissions: ugo+rw Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:07 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.info Nov 01 09:56:07 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:07 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.info" returned: 0 in 0.246s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-173bc8ea-f7a0-4c95-8549-ae8af2ac998a-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Lock "cinder-173bc8ea-f7a0-4c95-8549-ae8af2ac998a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:07 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-7cbd3527-7468-4964-8ae4-cb3f11648f4f tempest-SnapshotDependencyTests-1424281794 None] Create snapshot completed successfully Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6e42b8-06d8-433f-a0f6-0d1a69aa8a4e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:07 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:07 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a Nov 01 09:56:07 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:08 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" returned: 0 in 0.379s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:08 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a Nov 01 09:56:08 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Flow 'volume_create_manager' (a8330bfa-0c2e-4675-b177-931a40e9d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925f92c2-5023-4741-9038-5acf457656d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925f92c2-5023-4741-9038-5acf457656d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e976567-1a95-4805-9204-2a8d84ad4e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab522095310d47ed930d4ec7bfc728a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08f35153-b36b-4f76-a9e2-16b0979138b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:08Z,use_quota=True,user_id='8946a801dded48e49038e82e35613728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:08 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181b0ee5-3f1f-43d1-8708-1fcad938af6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181b0ee5-3f1f-43d1-8708-1fcad938af6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3637b39c-496b-4c42-8755-487d4688aaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3637b39c-496b-4c42-8755-487d4688aaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e976567-1a95-4805-9204-2a8d84ad4e57', 'volume_name': 'volume-5e976567-1a95-4805-9204-2a8d84ad4e57', 'volume_size': 1, 'snapshot_id': '08f35153-b36b-4f76-a9e2-16b0979138b7'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accd7f04-df9b-40bc-aec9-8ba213a77cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (accd7f04-df9b-40bc-aec9-8ba213a77cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5ce373-f3c9-4a2c-a625-3d73fa29fc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:08 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Volume 5e976567-1a95-4805-9204-2a8d84ad4e57: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e976567-1a95-4805-9204-2a8d84ad4e57', 'volume_size': 1, 'snapshot_id': '08f35153-b36b-4f76-a9e2-16b0979138b7'} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" returned: 0 in 0.309s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-quobyte-08f35153-b36b-4f76-a9e2-16b0979138b7-5e976567-1a95-4805-9204-2a8d84ad4e57" by "_create_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-173bc8ea-f7a0-4c95-8549-ae8af2ac998a" released by "delete_volume" :: held 0.764s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-08f35153-b36b-4f76-a9e2-16b0979138b7-5e976567-1a95-4805-9204-2a8d84ad4e57" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Creating volume 5e976567-1a95-4805-9204-2a8d84ad4e57 from snapshot 08f35153-b36b-4f76-a9e2-16b0979138b7 {{(pid=86594) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-quobyte-5e976567-1a95-4805-9204-2a8d84ad4e57" by "_copy_volume_from_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-5e976567-1a95-4805-9204-2a8d84ad4e57" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] snapshot: 08f35153-b36b-4f76-a9e2-16b0979138b7, volume: 5e976567-1a95-4805-9204-2a8d84ad4e57, {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Created reservations ['903b1d9d-6c5f-4a74-b0f2-06db3df24545', '7c226a9a-78d2-47ba-931c-8bb9bc63c886', 'a8892a0f-10d6-4549-9994-b9c87f2d0e54', '29e85734-34b5-49a8-9361-94e6a9de35fb'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d638470-3f70-496a-a4b3-2d02aec1eb8b]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:08 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:56:08 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:08 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 Nov 01 09:56:08 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:08 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.244s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:08 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:56:08 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-0da660d7-2c92-4183-8917-b50ede5415af tempest-ProjectMemberTests-1908354832 None] Lock "cinder-173bc8ea-f7a0-4c95-8549-ae8af2ac998a-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:09 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7" returned: 0 in 0.392s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a3b15-7031-498a-bfc7-415918470b30]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:09 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad Nov 01 09:56:09 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (3006c09b-f6ee-4ab6-a964-3c89e2d2beff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e575375-9fab-4c37-9b0f-bb87647020b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e575375-9fab-4c37-9b0f-bb87647020b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091470792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a8a36b-28d3-45e9-a96f-7c00499c4503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:09Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e30ce2-03b2-4fc5-8c3b-efdfb731ee2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e30ce2-03b2-4fc5-8c3b-efdfb731ee2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41f2dc5-8dc3-4c02-930f-bc10088fa892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b41f2dc5-8dc3-4c02-930f-bc10088fa892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a8a36b-28d3-45e9-a96f-7c00499c4503', 'volume_name': 'volume-44a8a36b-28d3-45e9-a96f-7c00499c4503', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31c63f4-4e9e-4930-8427-417c3d0e52b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31c63f4-4e9e-4930-8427-417c3d0e52b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b67c53-d180-489d-82f7-e88b7c53b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:09 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Volume 44a8a36b-28d3-45e9-a96f-7c00499c4503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a8a36b-28d3-45e9-a96f-7c00499c4503', 'volume_size': 1} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:09 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" returned: 0 in 0.385s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] will copy from snapshot at /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Creating direct copy from snapshot {{(pid=86594) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG cinder.utils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Path /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 not found in is_blk_device check {{(pid=86594) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 09:56:09 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:09 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 Nov 01 09:56:09 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:15 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57" returned: 0 in 5.935s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.image.image_utils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Image conversion details: src /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 {{(pid=86594) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 09:56:15 devstack cinder-volume[86594]: INFO cinder.image.image_utils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Converted 1024.00 MB image at 172.49 MB/s Nov 01 09:56:15 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 is being set with open permissions: ugo+rw Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:15 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 Nov 01 09:56:15 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:15 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57" returned: 0 in 0.236s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-5e976567-1a95-4805-9204-2a8d84ad4e57" released by "_copy_volume_from_snapshot" :: held 7.045s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-08f35153-b36b-4f76-a9e2-16b0979138b7-5e976567-1a95-4805-9204-2a8d84ad4e57" released by "_create_volume_from_snapshot" :: held 7.110s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.126s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.249s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091470792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a8a36b-28d3-45e9-a96f-7c00499c4503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:09Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Creating volume 44a8a36b-28d3-45e9-a96f-7c00499c4503 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:56:15 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:15 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 1073741824 Nov 01 09:56:15 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5ce373-f3c9-4a2c-a625-3d73fa29fc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e976567-1a95-4805-9204-2a8d84ad4e57', 'volume_size': 1, 'snapshot_id': '08f35153-b36b-4f76-a9e2-16b0979138b7'}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbc6409-303e-4460-9b57-a3e5a2cd53c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:15 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Volume volume-5e976567-1a95-4805-9204-2a8d84ad4e57 (5e976567-1a95-4805-9204-2a8d84ad4e57): created successfully Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbc6409-303e-4460-9b57-a3e5a2cd53c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:15 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Flow 'volume_create_manager' (a8330bfa-0c2e-4675-b177-931a40e9d789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:15 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-4264aad3-84f8-4c6b-a4ec-88de14ae1d41 tempest-SnapshotDependencyTests-1424281794 None] Created volume successfully. Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-08f35153-b36b-4f76-a9e2-16b0979138b7-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-08f35153-b36b-4f76-a9e2-16b0979138b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-quobyte-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-quobyte-08f35153-b36b-4f76-a9e2-16b0979138b7" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-08f35153-b36b-4f76-a9e2-16b0979138b7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Deleting offline snapshot 08f35153-b36b-4f76-a9e2-16b0979138b7 of volume 9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:56:16 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] snapshot_file for this snap is: volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 1073741824" returned: 0 in 0.470s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241c5ad-1142-4847-ab88-dce6c38a1bef]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:16 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 Nov 01 09:56:16 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:16 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 Nov 01 09:56:16 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:16 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503" returned: 0 in 0.257s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1b67c53-d180-489d-82f7-e88b7c53b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a8a36b-28d3-45e9-a96f-7c00499c4503', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01cdd9a-9c49-4f14-9e1c-73ea054eebc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:16 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Volume volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 (44a8a36b-28d3-45e9-a96f-7c00499c4503): created successfully Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d01cdd9a-9c49-4f14-9e1c-73ea054eebc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (3006c09b-f6ee-4ab6-a964-3c89e2d2beff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:16 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-67a5e0a8-285b-49fe-a790-f6a4b357c712 tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:56:16 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7" returned: 0 in 0.361s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f72a0c-4f2d-4360-87ef-b67011ea6414]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:16 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:16 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad Nov 01 09:56:16 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot 2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 of volume 44a8a36b-28d3-45e9-a96f-7c00499c4503 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[38abae0d-4e12-427c-b002-c9bfc3ecbf81]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:17 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" returned: 0 in 0.534s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:17 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 Nov 01 09:56:17 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:17 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 Nov 01 09:56:17 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:17 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503" returned: 0 in 0.364s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:17 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7" returned: 0 in 0.342s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:17 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 1G Nov 01 09:56:17 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:17 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7 Nov 01 09:56:17 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:17 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad.08f35153-b36b-4f76-a9e2-16b0979138b7" returned: 0 in 0.254s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-08f35153-b36b-4f76-a9e2-16b0979138b7" released by "_delete_snapshot" :: held 1.597s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" released by "delete_snapshot" :: held 1.622s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Created reservations ['137e3d1c-138f-413f-828a-5965c51ac6f5', 'a92f68a9-6f89-4ba0-977a-e9b124642ce4', '17afd09b-5b15-4439-8be5-5c8a31206e5b', '5f67b5a7-03f2-42af-833a-1406b95c5eeb'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:17 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 1G" returned: 0 in 0.396s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:17 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 Nov 01 09:56:17 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:17 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Delete snapshot completed successfully. Nov 01 09:56:17 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-e4f92803-97e6-4d36-ab22-92d34fc2256a tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-08f35153-b36b-4f76-a9e2-16b0979138b7-delete_snapshot" released by "delete_snapshot" :: held 1.778s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:18 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5" returned: 0 in 0.279s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:18 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 is being set with open permissions: ugo+rw Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:18 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 Nov 01 09:56:18 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-9f6f6d33-bf36-4cb1-949d-ea40c84952ad-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-9f6f6d33-bf36-4cb1-949d-ea40c84952ad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-quobyte-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:18 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[a654f93e-1e7f-4d9e-8c7a-fd16cf96df16]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5" returned: 0 in 0.276s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:18 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.info Nov 01 09:56:18 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:18 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad Nov 01 09:56:18 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:18 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.info" returned: 0 in 0.269s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:18 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.info is being set with open permissions: ugo+rw Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:18 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.info Nov 01 09:56:18 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:18 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" returned: 0 in 0.374s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:18 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad Nov 01 09:56:18 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:18 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.info" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:18 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:18 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-31dae36f-0674-4007-8a4c-d747ad3c61ce tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:56:19 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" returned: 0 in 0.254s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-9f6f6d33-bf36-4cb1-949d-ea40c84952ad" released by "delete_volume" :: held 0.693s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Created reservations ['a4a94309-1bbe-4b5b-a02d-53bc2fbd7e99', '50280ffa-2bbe-4ad8-a487-53993085d506', '5b4d271d-0f04-4973-8626-e11a44cfdd7a', '1ed7414e-8c54-4233-816e-081895db8a40'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:19 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:56:19 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-44a8a36b-28d3-45e9-a96f-7c00499c4503" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-44a8a36b-28d3-45e9-a96f-7c00499c4503" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot 2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 of volume 44a8a36b-28d3-45e9-a96f-7c00499c4503 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ca6047-f641-4d6a-9f9f-38d163caca5d]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:19 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 Nov 01 09:56:19 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:19 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.264s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-5e976567-1a95-4805-9204-2a8d84ad4e57-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:19 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Deleted volume successfully. Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-5e976567-1a95-4805-9204-2a8d84ad4e57-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-f2ff9020-1296-4707-a786-625a43500ccc tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-9f6f6d33-bf36-4cb1-949d-ea40c84952ad-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "cinder-quobyte-5e976567-1a95-4805-9204-2a8d84ad4e57" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-5e976567-1a95-4805-9204-2a8d84ad4e57" acquired by "delete_volume" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d87008-d224-4867-bc51-80e7ce32b9e3]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:19 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5" returned: 0 in 0.398s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a8a36b-28d3-45e9-a96f-7c00499c4503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:56:19 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 Nov 01 09:56:19 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf7e934-423d-4ec3-a4ed-7be0a7e78e25]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:19 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 Nov 01 09:56:19 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:19 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57" returned: 0 in 0.377s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:19 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:19 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57 Nov 01 09:56:19 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:20 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503" returned: 0 in 0.351s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:20 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 Nov 01 09:56:20 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:20 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5e976567-1a95-4805-9204-2a8d84ad4e57" returned: 0 in 0.267s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-quobyte-5e976567-1a95-4805-9204-2a8d84ad4e57" released by "delete_volume" :: held 0.691s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Created reservations ['0c2608ff-f9d6-4937-86fb-3c82f6052f1d', '2e29f0e8-accf-49df-bb63-638d0ac2dc61', 'c8f907e4-46ef-49d8-91c3-6cbb4f76a267', 'ae59c8c5-bae1-4c54-bcd3-42a8dd4997b1'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:20 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:56:20 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:20 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5" returned: 0 in 0.354s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:20 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5 Nov 01 09:56:20 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:20 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:56:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Deleted volume successfully. Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a500d9f9-5901-4b32-96f7-584fd533bfef tempest-SnapshotDependencyTests-1424281794 None] Lock "cinder-5e976567-1a95-4805-9204-2a8d84ad4e57-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:20 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503.2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5" returned: 0 in 0.260s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5" released by "_delete_snapshot" :: held 1.464s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-44a8a36b-28d3-45e9-a96f-7c00499c4503" released by "delete_snapshot" :: held 1.492s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Created reservations ['cd4361fe-2453-4c7d-96a6-cec6ff64835e', '223bccca-4231-4c01-a7b6-a653f2a4301c', '575bded6-b78d-4f41-a50e-ce58f325c830', '3a6ad3cc-543e-4594-a556-87b1f553482f'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:20 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:56:20 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d66d48e7-cb86-4592-92e1-9b76241126a2 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-2ca7ad2e-dc58-43c0-a386-ee69a5b52ea5-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-44a8a36b-28d3-45e9-a96f-7c00499c4503-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-44a8a36b-28d3-45e9-a96f-7c00499c4503-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-44a8a36b-28d3-45e9-a96f-7c00499c4503" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:21 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-44a8a36b-28d3-45e9-a96f-7c00499c4503" acquired by "delete_volume" :: waited 0.035s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:21 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b55ab4-9f6a-4d98-871d-330e54295058]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:21 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 Nov 01 09:56:21 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:21 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503" returned: 0 in 0.395s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:21 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:21 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503 Nov 01 09:56:21 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:22 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-44a8a36b-28d3-45e9-a96f-7c00499c4503" returned: 0 in 0.290s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-44a8a36b-28d3-45e9-a96f-7c00499c4503" released by "delete_volume" :: held 0.755s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Created reservations ['b03d40ee-37d9-47d0-8a16-a3f634821df5', '218d3ddb-d23b-4e76-8d14-d6348cc83d3c', '90583974-5897-41b1-884f-6a0314867be8', '97743835-c1ba-4644-9718-751987d44347'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:22 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:56:22 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:22 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.264s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:56:22 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:56:22 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-58f6bfa6-7b72-489d-846d-acb6feb69352 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-44a8a36b-28d3-45e9-a96f-7c00499c4503-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (f7053e89-7fe5-4aad-93a2-9ca3fbc04931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ead763-6609-4c4e-9981-23d8287d4cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ead763-6609-4c4e-9981-23d8287d4cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471106021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4f7080-fc19-4fd6-9d13-677d33bc7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:23Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c5013d-abd3-43e7-821f-e37495691c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c5013d-abd3-43e7-821f-e37495691c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7494b07-cd61-4833-8727-8bfeff5ddfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7494b07-cd61-4833-8727-8bfeff5ddfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4f7080-fc19-4fd6-9d13-677d33bc7ca5', 'volume_name': 'volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95472d62-b6b6-4af2-b15c-7a66e32f4e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95472d62-b6b6-4af2-b15c-7a66e32f4e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73077949-7243-437a-b599-82d3da35e53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Volume 4d4f7080-fc19-4fd6-9d13-677d33bc7ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5', 'volume_size': 1} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-471106021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4f7080-fc19-4fd6-9d13-677d33bc7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:23Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Creating volume 4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:56:23 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:23 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 1073741824 Nov 01 09:56:23 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:23 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 1073741824" returned: 0 in 0.411s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:23 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 Nov 01 09:56:23 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:23 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" returned: 0 in 0.250s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73077949-7243-437a-b599-82d3da35e53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c225a96a-49ff-4000-88f7-22ab9c1dc258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:23 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Volume volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 (4d4f7080-fc19-4fd6-9d13-677d33bc7ca5): created successfully Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c225a96a-49ff-4000-88f7-22ab9c1dc258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:23 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (f7053e89-7fe5-4aad-93a2-9ca3fbc04931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:23 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-0e4a961d-501c-4919-ae31-8bc7d7ead68d tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:56:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:24 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 of volume 4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:56:24 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bb1c26-30b8-42a6-9797-27c6808d95d7]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:24 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 Nov 01 09:56:24 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:24 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" returned: 0 in 0.398s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:24 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:24 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 1G Nov 01 09:56:24 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:25 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 1G" returned: 0 in 0.476s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:25 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 Nov 01 09:56:25 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:25 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3" returned: 0 in 0.293s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:25 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 is being set with open permissions: ugo+rw Nov 01 09:56:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:25 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 Nov 01 09:56:25 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:25 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3" returned: 0 in 0.256s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:25 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.info Nov 01 09:56:25 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:25 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.info" returned: 0 in 0.263s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:25 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.info is being set with open permissions: ugo+rw Nov 01 09:56:25 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:26 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.info Nov 01 09:56:26 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:26 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.info" returned: 0 in 0.253s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:26 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:26 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-1b0c2e89-fc79-4ba4-9064-b34729ae682c tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-a62beaa7-9b9f-4b05-a5a3-fb49064a97e3-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Lock "cinder-a62beaa7-9b9f-4b05-a5a3-fb49064a97e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-a62beaa7-9b9f-4b05-a5a3-fb49064a97e3" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-a62beaa7-9b9f-4b05-a5a3-fb49064a97e3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 of volume 4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[c296ae77-3389-4e71-b08d-45dea59f5655]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:27 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 Nov 01 09:56:27 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:27 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3" returned: 0 in 0.348s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f2de4c-a451-4412-b024-307344625004]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:27 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:27 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 Nov 01 09:56:27 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:28 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" returned: 0 in 0.380s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:28 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 Nov 01 09:56:28 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:28 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3" returned: 0 in 0.411s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:28 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3 Nov 01 09:56:28 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:28 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:28 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5.a62beaa7-9b9f-4b05-a5a3-fb49064a97e3" returned: 0 in 0.266s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-a62beaa7-9b9f-4b05-a5a3-fb49064a97e3" released by "_delete_snapshot" :: held 1.500s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:28 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" released by "delete_snapshot" :: held 1.523s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:29 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Created reservations ['02c91c86-c307-436d-b8ca-e182a45393f5', '8cdcfd12-0b6e-48d3-ad00-e9171c3c4131', '843e652f-003b-42a9-944b-3d8447279529', '1c370d40-c7df-4889-9af8-eb154f8962ef'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:29 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:56:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-17e267f8-e201-4b91-86dc-7ffd639cbfcd tempest-ProjectMemberTests-1908354832 None] Lock "cinder-a62beaa7-9b9f-4b05-a5a3-fb49064a97e3-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:29 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" acquired by "delete_volume" :: waited 0.027s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:29 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f3904-d040-4c4d-a5b8-2b03aa1e1092]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:29 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:29 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 Nov 01 09:56:29 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:30 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" returned: 0 in 0.396s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:30 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5 Nov 01 09:56:30 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:30 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" returned: 0 in 0.258s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5" released by "delete_volume" :: held 0.722s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Created reservations ['1c3efb4c-be26-4fb2-9a49-4786439d91ca', '3087ed72-cbf3-4e91-9132-96ac289c8370', '492b0816-77e6-4896-b256-b330ac4ebcd1', 'f01b57c2-1498-4cf4-a34a-42ab3b7b4e00'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:30 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:56:30 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:30 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.294s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:56:30 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:56:30 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-d7b08bbd-4515-407c-9706-10726ec8c0d6 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-4d4f7080-fc19-4fd6-9d13-677d33bc7ca5-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.flows.manager.create_volume [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86594) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (707e6414-8e6d-44e9-9db2-3ad8c7db467f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9745c5-67fd-437a-b0c0-ad976deb5fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc9745c5-67fd-437a-b0c0-ad976deb5fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-889798989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5679e311-c6e6-4149-8c1f-e64144d33a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:31Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25189ee6-879f-4675-8f7b-886ae3a15699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25189ee6-879f-4675-8f7b-886ae3a15699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c22726-ef22-471e-9517-2b4d05e65ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c22726-ef22-471e-9517-2b4d05e65ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5679e311-c6e6-4149-8c1f-e64144d33a70', 'volume_name': 'volume-5679e311-c6e6-4149-8c1f-e64144d33a70', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d460416e-dbfd-4a28-8d16-9980511863b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d460416e-dbfd-4a28-8d16-9980511863b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f44c09c-6780-4f24-baa7-73156e4a9e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:31 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Volume 5679e311-c6e6-4149-8c1f-e64144d33a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5679e311-c6e6-4149-8c1f-e64144d33a70', 'volume_size': 1} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T08:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-889798989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5679e311-c6e6-4149-8c1f-e64144d33a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e5ef6798e54f95b6facc6b47321072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T08:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T08:56:31Z,use_quota=True,user_id='064c596cda694810ac89200b78f14156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c8c6b9fa-260f-459d-bf0d-514358b1561e),volume_type_id=c8c6b9fa-260f-459d-bf0d-514358b1561e)}" {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Creating volume 5679e311-c6e6-4149-8c1f-e64144d33a70 {{(pid=86594) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Selected osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 as target Quobyte volume. {{(pid=86594) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 09:56:31 devstack cinder-volume[86594]: INFO cinder.volume.drivers.remotefs [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] casted to osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642 Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 1073741824 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:31 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 1073741824 Nov 01 09:56:31 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:31 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 1073741824" returned: 0 in 0.439s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:31 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:31 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 Nov 01 09:56:31 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:32 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70" returned: 0 in 0.248s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'} {{(pid=86594) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f44c09c-6780-4f24-baa7-73156e4a9e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5679e311-c6e6-4149-8c1f-e64144d33a70', 'volume_size': 1}' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1782a47d-3b27-480a-8e2f-9ac3d4380fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 09:56:32 devstack cinder-volume[86594]: INFO cinder.volume.flows.manager.create_volume [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Volume volume-5679e311-c6e6-4149-8c1f-e64144d33a70 (5679e311-c6e6-4149-8c1f-e64144d33a70): created successfully Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1782a47d-3b27-480a-8e2f-9ac3d4380fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86594) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Flow 'volume_create_manager' (707e6414-8e6d-44e9-9db2-3ad8c7db467f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86594) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 09:56:32 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-3601026f-1f04-4878-be99-d32cb95702fd tempest-ProjectMemberTests-1908354832 None] Created volume successfully. Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Creating offline snapshot a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 of volume 5679e311-c6e6-4149-8c1f-e64144d33a70 {{(pid=86594) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3835896-1a90-4047-8780-8c97c6967e6e]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:32 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 Nov 01 09:56:32 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:32 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70" returned: 0 in 0.379s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:32 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 1G {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:32 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 1G Nov 01 09:56:32 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:33 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 1G" returned: 0 in 0.381s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5679e311-c6e6-4149-8c1f-e64144d33a70 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:33 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5679e311-c6e6-4149-8c1f-e64144d33a70 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 Nov 01 09:56:33 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:33 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5679e311-c6e6-4149-8c1f-e64144d33a70 -F qcow2 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63" returned: 0 in 0.281s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:33 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 is being set with open permissions: ugo+rw Nov 01 09:56:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:33 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 Nov 01 09:56:33 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:33 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63" returned: 0 in 0.239s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:33 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.info Nov 01 09:56:33 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:33 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.info" returned: 0 in 0.252s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:33 devstack cinder-volume[86594]: WARNING cinder.volume.drivers.remotefs [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.info is being set with open permissions: ugo+rw Nov 01 09:56:33 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.info {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:33 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.info Nov 01 09:56:33 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:34 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.info" returned: 0 in 0.243s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:34 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-64d26c22-ee1a-4a33-bf6f-063474372e56 tempest-ProjectMemberTests-1908354832 None] Create snapshot completed successfully Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63-delete_snapshot" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-5679e311-c6e6-4149-8c1f-e64144d33a70" by "delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-5679e311-c6e6-4149-8c1f-e64144d33a70" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63" by "_delete_snapshot" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Deleting offline snapshot a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 of volume 5679e311-c6e6-4149-8c1f-e64144d33a70 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] snapshot_file for this snap is: volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 {{(pid=86594) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac725d-9d8b-4bfd-bda2-9d4d9bbb83ce]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:34 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:34 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 Nov 01 09:56:34 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:35 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63" returned: 0 in 0.367s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:35 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.remotefs [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5679e311-c6e6-4149-8c1f-e64144d33a70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86594) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 09:56:35 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd69fa6-7551-4c37-8d7d-3e0cf728cf82]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:35 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 Nov 01 09:56:35 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:35 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70" returned: 0 in 0.362s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:35 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 Nov 01 09:56:35 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:35 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63" returned: 0 in 0.345s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:35 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:35 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63 Nov 01 09:56:35 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:36 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70.a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63" returned: 0 in 0.242s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63" released by "_delete_snapshot" :: held 1.416s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-5679e311-c6e6-4149-8c1f-e64144d33a70" released by "delete_snapshot" :: held 1.436s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Created reservations ['f9be26d1-a177-42a4-9ddb-30da5d228f5a', '6c3faae2-535f-4ce7-8fe9-2ad380298139', '0913aa29-0241-4223-8267-265a730f3467', '3f5b85b0-d15b-45e1-a37d-7c5f91b815ce'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:36 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Delete snapshot completed successfully. Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-a6f84e40-f53f-489a-ac7f-83545b0b9b90 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-a3956e94-c9c4-4b36-bbd0-67ebd7eb0f63-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-5679e311-c6e6-4149-8c1f-e64144d33a70-delete_volume" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-5679e311-c6e6-4149-8c1f-e64144d33a70-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "cinder-quobyte-5679e311-c6e6-4149-8c1f-e64144d33a70" by "delete_volume" {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-5679e311-c6e6-4149-8c1f-e64144d33a70" acquired by "delete_volume" :: waited 0.014s {{(pid=86594) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG oslo.privsep.daemon [-] privsep: reply[014e45a6-cc29-4958-900b-212dad542a37]: (4, 'qcow2') {{(pid=87881) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 09:56:36 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:36 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 Nov 01 09:56:36 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:37 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70" returned: 0 in 0.355s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:37 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70 Nov 01 09:56:37 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:37 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00/volume-5679e311-c6e6-4149-8c1f-e64144d33a70" returned: 0 in 0.236s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-quobyte-5679e311-c6e6-4149-8c1f-e64144d33a70" released by "delete_volume" :: held 0.650s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG cinder.quota [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Created reservations ['a1ac5b91-1255-4c04-a74a-1a1348ecb51c', '73475bf2-c7c2-40ee-83ab-e8c662b74f2a', 'eebcd6ed-2045-4b96-ab10-ffa16bd17317', 'b5116f35-b2d8-48ad-8e21-ece72383af4b'] {{(pid=86594) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:37 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:56:37 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:37 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.244s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:56:37 devstack cinder-volume[86594]: INFO cinder.volume.manager [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Deleted volume successfully. Nov 01 09:56:37 devstack cinder-volume[86594]: DEBUG cinder.coordination [None req-5adaabaa-b90f-4424-a0d9-7c9d0461a9e8 tempest-ProjectMemberTests-1908354832 None] Lock "cinder-5679e311-c6e6-4149-8c1f-e64144d33a70-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=86594) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 09:56:47 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=103,cinder:SELECT=80,cinder:DELETE=8,cinder:INSERT=27 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:56:47 devstack cinder-volume[86594]: DEBUG dbcounter [-] [86594] Writing DB stats cinder:UPDATE=95,cinder:DELETE=9,cinder:SELECT=78,cinder:INSERT=27 {{(pid=86594) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642': None} {{(pid=86594) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG cinder.volume.drivers.quobyte [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f6060b0d-ea6e-45a6-a0fe-0637b877d642'] {{(pid=86594) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.lockutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86594) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 09:56:53 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00 Nov 01 09:56:53 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 09:56:53 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG oslo_concurrency.processutils [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/364410e5275a1560ece7f8c5a16b4e00" returned: 0 in 0.240s {{(pid=86594) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG cinder.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Notifying Schedulers of capabilities ... {{(pid=86594) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG oslo_service.periodic_task [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] Running periodic task VolumeManager._thread_info {{(pid=86594) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread count: 28 {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 09:56:53 devstack cinder-volume[86594]: DEBUG cinder.volume.manager [None req-a37e7597-d7a0-49f4-9ffe-72d5c2eadbb3 None None] thread info: [<_MainThread(MainThread, started 137143116902528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86594) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}